-- Logs begin at Wed 2022-08-31 12:16:05 UTC, end at Wed 2022-08-31 13:36:22 UTC. -- Aug 31 12:50:30.257190 dv-cinder-854428-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 12:50:30.266459 dv-cinder-854428-2-iscsi devstack@n-api.service[105523]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 12:50:30.268367 dv-cinder-854428-2-iscsi devstack@n-api.service[105523]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 12:50:30 2022] *** Aug 31 12:50:30.268367 dv-cinder-854428-2-iscsi devstack@n-api.service[105523]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 12:50:30.268367 dv-cinder-854428-2-iscsi devstack@n-api.service[105523]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 12:50:30.268367 dv-cinder-854428-2-iscsi devstack@n-api.service[105523]: nodename: dv-cinder-854428-2-iscsi Aug 31 12:50:30.268367 dv-cinder-854428-2-iscsi devstack@n-api.service[105523]: machine: x86_64 Aug 31 12:50:30.268367 dv-cinder-854428-2-iscsi devstack@n-api.service[105523]: clock source: unix Aug 31 12:50:30.268367 dv-cinder-854428-2-iscsi devstack@n-api.service[105523]: pcre jit disabled Aug 31 12:50:30.268367 dv-cinder-854428-2-iscsi devstack@n-api.service[105523]: detected number of CPU cores: 4 Aug 31 12:50:30.268367 dv-cinder-854428-2-iscsi devstack@n-api.service[105523]: current working directory: / Aug 31 12:50:30.268367 dv-cinder-854428-2-iscsi devstack@n-api.service[105523]: detected binary path: /usr/bin/uwsgi-core Aug 31 12:50:30.268367 dv-cinder-854428-2-iscsi devstack@n-api.service[105523]: your processes number limit is 47680 Aug 31 12:50:30.268367 dv-cinder-854428-2-iscsi devstack@n-api.service[105523]: your memory page size is 4096 bytes Aug 31 12:50:30.268367 dv-cinder-854428-2-iscsi devstack@n-api.service[105523]: detected max file descriptor number: 2048 Aug 31 12:50:30.268367 dv-cinder-854428-2-iscsi devstack@n-api.service[105523]: lock engine: pthread robust mutexes Aug 31 12:50:30.269333 dv-cinder-854428-2-iscsi devstack@n-api.service[105523]: thunder lock: enabled Aug 31 12:50:30.269333 dv-cinder-854428-2-iscsi devstack@n-api.service[105523]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 12:50:30.269333 dv-cinder-854428-2-iscsi devstack@n-api.service[105523]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 12:50:30.307316 dv-cinder-854428-2-iscsi devstack@n-api.service[105523]: Python main interpreter initialized at 0x55c8c951a9c0 Aug 31 12:50:30.307316 dv-cinder-854428-2-iscsi devstack@n-api.service[105523]: python threads support enabled Aug 31 12:50:30.307316 dv-cinder-854428-2-iscsi devstack@n-api.service[105523]: your server socket listen backlog is limited to 100 connections Aug 31 12:50:30.307316 dv-cinder-854428-2-iscsi devstack@n-api.service[105523]: your mercy for graceful operations on workers is 90 seconds Aug 31 12:50:30.307711 dv-cinder-854428-2-iscsi devstack@n-api.service[105523]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 12:50:30.307711 dv-cinder-854428-2-iscsi devstack@n-api.service[105523]: *** Operational MODE: preforking *** Aug 31 12:50:30.308005 dv-cinder-854428-2-iscsi devstack@n-api.service[105523]: *** uWSGI is running in multiple interpreter mode *** Aug 31 12:50:30.308005 dv-cinder-854428-2-iscsi devstack@n-api.service[105523]: spawned uWSGI master process (pid: 105523) Aug 31 12:50:30.308212 dv-cinder-854428-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 31 12:50:30.311633 dv-cinder-854428-2-iscsi devstack@n-api.service[105523]: spawned uWSGI worker 1 (pid: 105524, cores: 1) Aug 31 12:50:30.311633 dv-cinder-854428-2-iscsi devstack@n-api.service[105523]: spawned uWSGI worker 2 (pid: 105525, cores: 1) Aug 31 12:50:30.311633 dv-cinder-854428-2-iscsi devstack@n-api.service[105523]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 12:50:30.959912 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 12:50:30.960433 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 12:50:32.025428 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 12:50:32.025428 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: from cryptography.utils import int_from_bytes Aug 31 12:50:32.026090 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 12:50:32.026090 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: from cryptography.utils import int_from_bytes Aug 31 12:50:32.026888 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 12:50:32.026888 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: from cryptography.utils import int_from_bytes Aug 31 12:50:32.027381 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 12:50:32.027381 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: from cryptography.utils import int_from_bytes Aug 31 12:50:34.498562 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 12:50:34.499242 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 12:50:34.499329 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 12:50:34.499656 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 12:50:34.499934 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 12:50:34.500313 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.500630 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.500934 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.501246 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.501595 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.501904 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.502219 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.502531 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.502830 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.503086 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.503392 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.503711 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854428-2-iscsi {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.504053 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.504357 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.504659 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.504968 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.505262 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.505560 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.505857 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.506341 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.506777 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.506881 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 12:50:34.507231 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.507308 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 12:50:34.507382 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.507609 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 12:50:34.507702 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.507998 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.508092 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 12:50:34.508251 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 12:50:34.508343 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.508600 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.508697 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.508900 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.508985 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.509216 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.509299 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.509518 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.509609 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.509853 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.509947 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854428-2-iscsi {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.510167 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.510268 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.510483 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.510567 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.510795 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.510887 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.511117 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.511201 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.511376 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.511493 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.511698 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.511804 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.512038 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854428-2-iscsi {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.512144 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.512354 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.512440 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.512658 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.512745 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.512961 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.513046 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.513275 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.513389 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.513655 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.513740 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.513968 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.514050 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.514265 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.514363 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.514567 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.514758 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.514880 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.515065 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.515152 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.515370 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.515498 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.515669 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.515762 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.515998 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.516092 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.516302 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.516403 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.516612 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.516711 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.516924 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.517019 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.517225 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.517324 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.517475 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.517620 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.517713 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.517833 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.518020 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.518223 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854428-2-iscsi {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.518334 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.518530 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.518622 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.518834 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.518917 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.519140 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.519234 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.519496 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.519589 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.519795 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.519912 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.520119 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.520203 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.520422 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.520522 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.520725 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.520821 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.521046 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.521130 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.521356 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.521441 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.521668 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.521758 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.521969 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.522074 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.522285 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.522381 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.522579 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.522681 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.522887 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.522977 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.523195 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.523288 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.523509 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.523605 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.523838 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.523946 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.524133 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.524224 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.524380 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.524464 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.524688 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.524772 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.525007 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.525090 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.525322 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.525509 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.525623 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.525717 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.525872 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.525969 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.526120 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.526249 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.526435 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.526527 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.526751 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.526848 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.527055 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.527158 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.527354 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.527446 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.527655 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.527760 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.527991 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.528218 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.528307 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.528385 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.528563 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.528649 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.528862 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.528973 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.529192 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.529287 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.529492 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.529585 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.529793 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.529885 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.530093 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.530185 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.530391 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.530494 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.530688 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.530780 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.530993 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.531085 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.531290 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.531380 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.531585 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.531669 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.531921 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.532010 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.532236 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.532386 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.532538 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.532628 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.532836 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.532928 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.533134 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.533227 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.533434 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.533525 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.533731 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.533812 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.534032 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.534116 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.534330 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.534428 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.534642 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.534734 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.534938 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.535021 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.535183 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.535308 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.535498 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.535624 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.535785 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.535902 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.536122 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.536213 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.536425 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.536517 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.536719 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.536801 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.537017 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.537113 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.537313 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.537472 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.537641 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.537779 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.537912 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.537996 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.538207 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.538301 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.538503 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.538586 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.538797 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.538885 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.539090 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.539175 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.539382 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.539465 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.539677 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.539773 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.539995 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.540081 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.540305 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.540390 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.540616 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.540698 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.540921 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.541004 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.541219 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.541308 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.541514 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.541609 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.541818 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.541909 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.542132 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.542222 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.542435 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.542519 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.542735 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.542820 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.543051 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.543146 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.543350 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.543442 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.543652 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.543759 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.543986 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.544074 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.544290 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.544382 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.544641 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.544776 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.545168 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.545259 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.545477 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.545683 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.545833 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.546076 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.546221 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.546392 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.546709 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.546803 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.547051 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.547134 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.547374 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.547507 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.547782 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.547912 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.548234 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.548372 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.548826 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.549056 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.549149 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.549377 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.549468 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.549766 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.549849 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.550071 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.550163 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.550397 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.550479 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.550727 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.550818 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.551036 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.551127 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.551357 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.551440 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.551666 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.551747 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.551996 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.552080 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.552305 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.552398 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:50:34.552606 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.552690 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.552925 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.553028 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.553252 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.553337 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.553559 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.553642 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.553870 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.553956 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.554175 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.554262 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.554493 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.554583 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.554800 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.554885 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.555103 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.555187 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.555410 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.555494 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.555718 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.555908 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.556049 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.556135 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.556361 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.556445 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.556672 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.556761 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.556987 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.557069 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.557296 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.557396 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.557608 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.557692 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.557918 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.558015 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.558226 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.558328 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.558532 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.558615 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.558834 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.558918 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.559133 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.559227 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.559432 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.559516 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.559732 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.559834 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.560062 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.560228 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.560385 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.560471 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.560703 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.560839 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.561026 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.561112 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.561327 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.561412 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.561633 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.561715 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.561939 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.562022 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.562243 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.562326 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.562544 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.562627 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.562849 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.562933 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.563147 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.563231 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.563454 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.563598 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.563757 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.563870 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.564083 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.564167 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.564402 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.564488 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.564706 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.564791 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.565007 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.565090 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.565318 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.565412 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.565615 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.565739 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.565915 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.565999 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.566225 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.566318 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.566529 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.566613 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.566832 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.566916 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.567139 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.567240 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.567442 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.567526 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.567750 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.567864 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.568090 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.568186 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.568398 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.568480 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.568698 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.568781 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.568999 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.569083 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.569300 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.569390 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.569603 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.569688 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.569903 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.569987 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.570220 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.570310 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.570517 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.570606 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.570828 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.570912 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.571126 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.571219 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.571425 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.571508 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.571723 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.571850 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.572049 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.572143 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.572344 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.572440 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.572642 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.572733 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.572940 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.573023 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.573237 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.573329 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.573533 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.573623 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.573845 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.573937 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.574147 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.574237 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.574443 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.574533 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.574743 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.574855 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.575038 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.575141 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.575341 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.575480 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.575653 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.575749 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.576049 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.576140 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.576362 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.576447 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.576673 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.576757 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.576984 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.577070 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.577288 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.577380 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.577597 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.577689 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.577900 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.578035 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.578206 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.578298 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.578510 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.578595 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.578814 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.578898 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.579129 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.579213 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.579435 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.579531 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.579745 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.579886 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.580073 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.580158 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.580377 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.580473 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.580676 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.580760 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.580977 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.581061 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.581274 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.581367 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.581575 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.581665 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.581873 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.581956 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.582173 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.582270 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.582474 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.582559 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.582770 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.582893 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.583068 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.583153 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.583387 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.583471 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.583688 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.583771 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.584009 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.584095 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.584308 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.584393 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.584608 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.584693 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.584918 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.585009 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.585224 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.585315 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.585537 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.585621 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.585838 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.585924 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.586153 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.586237 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.586458 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.586552 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.586767 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.586849 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.587060 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.587143 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.587362 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.587453 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.587669 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.587752 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.587999 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.588123 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.588307 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.588477 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.588611 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.588695 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.588914 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.588996 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.589217 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.589313 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.589519 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.589603 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.589821 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.589903 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.590122 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.590218 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.590426 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.590557 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.590722 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.590827 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.591025 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.591153 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.591327 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.591412 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.591653 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.591737 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.591979 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.592066 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.592288 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.592372 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.592590 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.592674 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.592888 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.593016 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.593186 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.593270 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.593487 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.593569 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.593796 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.593888 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.594100 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.594190 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.594412 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.594507 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.594718 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.594808 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.595017 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.595099 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.595316 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.595415 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.595628 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.595710 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.595954 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.596041 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.596257 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.596351 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.596557 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.596648 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.596858 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.596943 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.597178 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.597274 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.597487 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.597570 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.597785 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.597877 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.598091 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.598223 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.598402 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.598493 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.598704 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.598793 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.599007 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.599093 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.599308 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.599391 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.599604 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.599695 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.599941 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.600027 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.600247 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.600331 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.600547 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.600629 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.600848 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.600939 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.601155 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.601238 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.601449 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.601539 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.601753 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.601836 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.602054 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.602136 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.602352 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.602445 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.602650 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.602741 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.602954 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.603038 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.603253 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.603351 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.603557 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.603642 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.603889 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.603978 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.604207 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.604460 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.604550 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.604792 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.604876 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.605104 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.605195 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.605405 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.605488 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.605707 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.605791 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.606007 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.606143 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.606307 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.606404 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.606647 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.606731 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.606953 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.607044 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.607291 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.607379 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.607596 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.607686 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.607926 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.608014 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.608234 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.608348 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.608541 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.608645 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.608842 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.608943 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.609142 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.609234 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.609441 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.609526 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.609744 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.609828 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.610043 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.610127 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.610341 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.610425 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.610639 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.610732 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.610940 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.611033 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.611243 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.611333 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.611540 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.611632 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.611865 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.611953 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.612166 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.612251 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.612469 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.612564 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.612768 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.612860 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.613067 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.613149 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.613368 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.613461 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.613670 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.613931 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.614022 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.614263 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.614419 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.614574 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.614658 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.614887 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.614970 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.615209 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.615301 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.615530 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.615620 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.615845 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.615947 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.616168 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.616252 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.616466 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.616557 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.616764 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.616848 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.617060 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.617144 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.617358 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.617450 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.617658 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.617750 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.617956 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.618041 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.618253 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.618377 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.618551 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.618635 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.618851 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.618944 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.619151 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.619241 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.619446 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.619528 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.619744 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.619862 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.620068 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.620152 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.620366 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.620449 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.620675 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.620767 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.620973 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.621057 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.621273 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.621356 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.621568 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.621678 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.621871 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.621965 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.622165 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.622256 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.622465 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.622562 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.622764 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.622856 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.623062 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.623154 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.623371 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.623455 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.623668 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.623759 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.623994 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.624081 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.624299 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.624384 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.624600 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.624685 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.624898 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.624989 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.625216 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.625302 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.625522 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.625606 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.625821 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.625913 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.626117 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.626201 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.626415 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.626509 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.626711 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.626803 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.627008 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.627092 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.627302 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.627393 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.627608 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.627706 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.627937 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.628024 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.628250 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.628350 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.628537 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.628632 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.628833 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.628917 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.629130 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.629214 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.629426 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.629511 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.629724 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.629814 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.630021 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.630105 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.630316 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.630400 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.630609 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.630694 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.630909 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.630998 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.631203 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.631287 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.631499 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.631582 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.631801 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.631925 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.632120 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.632205 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.632416 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.632506 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.632714 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.632812 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.633009 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.633091 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.633306 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.633425 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.633609 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.633703 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.633911 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.633994 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.634207 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.634290 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.634523 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.634615 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.634830 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.634914 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.635134 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.635223 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.635428 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.635519 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.635727 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.635829 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.636047 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.636130 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.636345 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.636438 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.636645 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.636736 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.636942 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.637031 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.637238 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.637323 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.637547 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.637650 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.637837 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.637926 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.638135 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.638219 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.638468 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.638551 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.638769 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.638861 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.639072 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.639164 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.639367 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.639451 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.639663 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.639747 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.639984 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.640073 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.640281 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.640366 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.640577 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.640675 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.640893 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.640985 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.641197 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.641288 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.641495 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.641630 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.641792 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.641876 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.642089 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.642180 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.642392 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.642484 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.642691 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.642776 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.642993 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.643084 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.643296 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.643391 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.643596 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.643682 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.643939 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.644027 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.644243 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.644330 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.644543 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.644635 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.644844 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.644927 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.645144 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.645229 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.645449 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.645531 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.645746 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.645827 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.646049 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.646166 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.646348 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.646474 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.646644 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.646784 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.646958 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.647084 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.647283 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.647389 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.647571 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.647695 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.647912 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.648033 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.648229 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.648342 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.648546 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.648640 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.648845 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.649035 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.649145 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.649343 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.649450 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.649649 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.649734 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.649954 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.650049 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.650251 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.650334 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.650548 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.650696 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.650856 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.651008 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.651172 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.651313 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.651470 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.651619 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.651767 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.651950 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.652090 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.652250 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.652408 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.652552 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.652705 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.652854 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.653051 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.653170 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.653417 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.653502 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.653722 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.653808 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.654043 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.654141 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.654345 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.654453 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.654646 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.654758 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.654957 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.655062 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.655256 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.655376 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.655777 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.655900 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.655997 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.656078 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.656308 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.656392 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.656608 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.656689 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.656908 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.656991 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.657212 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.657300 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.657522 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.657606 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.657829 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.657911 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.658124 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.658212 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.658456 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.658547 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.658772 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.658858 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.659089 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.659172 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.659396 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.659487 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.659702 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.659784 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.660025 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.660134 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.660331 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.660437 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.660649 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.660742 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.660949 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.661035 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.661248 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.661354 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.661546 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.661638 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.661863 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.661949 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.662160 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.662246 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.662476 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.662569 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.662788 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.662891 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.663106 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.663190 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.663404 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.663489 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.663711 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.663968 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.664058 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.664274 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.664371 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.664577 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.664661 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.664892 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.664975 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.665205 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.665297 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.665499 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.665582 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.665809 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.665893 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.666116 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.666207 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.666416 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.666498 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.666733 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.666816 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.667032 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.667116 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.667347 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.667429 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.667646 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.667737 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.667967 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.668044 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.668335 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.668498 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.668612 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.668880 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.668992 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.669173 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.669257 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.669486 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.669593 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.669861 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.670027 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.670186 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.670351 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.670492 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.670662 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.670825 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.670981 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.671146 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.671301 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.671463 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.671604 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.671775 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.671927 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.672122 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.672232 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.672427 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.672534 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.672726 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.672820 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.673030 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.673136 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.673329 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.673437 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.673931 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.674048 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.674230 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.674355 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.674532 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.674656 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.674831 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.674961 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.675130 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.675259 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.675427 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.675574 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.675743 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.675906 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.676070 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.676228 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.676391 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.676537 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.676694 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.676854 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.676995 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.677171 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.677294 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.677472 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.677590 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.677786 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.677925 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.678092 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.678228 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.678391 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.678554 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.678679 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.678859 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.678970 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.679178 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.679297 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.679492 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.679584 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.679803 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.679908 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.680138 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.680225 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.680450 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.680536 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.680770 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.680854 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.681080 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.681165 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.681390 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.681482 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.681691 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.681785 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.682001 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.682085 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.682309 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.682402 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.682617 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.682712 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.682932 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.683137 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.683222 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.683465 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.683557 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.683773 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.683899 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.684103 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.684235 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.684449 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.684558 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.684705 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.684791 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.685011 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.685104 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.685332 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.685428 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.685635 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.685719 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.685940 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.686024 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.686240 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.686398 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.686548 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.686640 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.686851 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.686981 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.687151 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.687284 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.687450 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.687535 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.687786 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.687945 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.688112 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.688197 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.688417 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.688510 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.688724 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.688809 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.689041 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.689125 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.689357 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.689442 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.689656 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.689748 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.689964 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.690048 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.690273 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.690357 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.690581 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.690678 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.690889 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.690981 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.691194 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.691278 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.691495 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.691587 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.691798 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.691916 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.692123 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.692210 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.692427 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.692521 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.692730 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.692944 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.693028 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.693272 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.693431 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.693582 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.693667 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.693893 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.693979 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.694200 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.694293 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.694512 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.694605 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.694824 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.694908 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.695129 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.695336 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.695421 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.695648 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.695732 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.696043 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.696141 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.696371 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.696457 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.696690 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.696774 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.696997 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.697088 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.697308 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.697393 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.697624 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.697707 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.697925 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.698017 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.698228 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.698321 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.698533 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.698615 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.698835 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.698928 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.699134 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.699219 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.699451 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.699534 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.699760 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.699934 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.700084 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.700171 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.700392 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.700474 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.700700 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.700809 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.701055 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.701273 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.701359 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.701611 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.701697 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.701922 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.702007 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.702230 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.702315 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.702535 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.702621 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.702841 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.702938 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.703138 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.703222 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.703455 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.703540 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.703754 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.703872 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.704081 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.704166 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.704385 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.704469 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.704689 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.704771 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.704991 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.705205 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.705290 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.705514 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.705609 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.705841 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.705925 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.706154 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.706285 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.706457 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.706545 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.706757 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.706841 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.707066 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.707191 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.707365 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.707488 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.707663 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.707757 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.707984 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.708071 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.708290 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.708374 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.708589 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.708680 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.708887 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.708977 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.709184 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.709267 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.709480 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.709576 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.709777 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.709860 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.710070 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.710152 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.710369 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.710462 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.710672 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.710893 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.710977 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.711235 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.711320 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.711545 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.711629 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.711884 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.711971 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.712207 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.712310 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.712504 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.712595 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.712801 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.712886 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.713112 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.713205 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.713413 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.713503 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.713713 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.713797 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.714016 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.714108 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.714319 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.714411 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.714619 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.714703 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.714925 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.715023 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.715228 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.715471 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.715588 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.715799 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.715946 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.716125 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.716217 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.716445 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.716537 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.716768 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.716862 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.717068 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.717156 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.717367 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.717451 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.717666 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.717792 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.717973 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.718058 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.718273 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.718357 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.718572 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.718657 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.718871 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.718956 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.719169 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.719254 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.719474 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.719566 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.719770 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.719880 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.720097 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.720189 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.720399 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.720483 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.720705 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.720797 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.721002 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.721087 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.721304 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.721395 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.721608 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.721693 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.721911 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.722072 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.722216 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.722308 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.722521 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.722604 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.722830 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.722924 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.723134 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.723243 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.723449 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.723534 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.723755 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.723879 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.724085 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.724169 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.724388 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.724483 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.724694 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.724787 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.724999 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.725241 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.725325 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.725572 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.725665 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.725890 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.725975 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.726199 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.726282 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.726499 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.726597 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.726818 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.726901 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.727119 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.727204 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.727420 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.727518 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.727740 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.727848 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.728073 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.728157 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.728378 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.728471 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.728683 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.728767 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.728988 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.729081 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.729293 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.729385 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.729596 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.729680 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.729900 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.729983 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.730203 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.730288 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.730506 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.730591 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.730810 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.730906 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.731116 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.731230 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.731414 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.731499 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.731713 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.731861 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.732053 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.732163 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.732398 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.732484 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.732700 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.732797 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.732997 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.733083 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.733294 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.733382 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.733596 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.733681 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.733895 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.733987 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.734193 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.734278 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.734490 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.734583 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.734787 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.734872 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.735087 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.735180 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.735382 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.735474 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.735676 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.735760 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.735997 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.736083 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.736298 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.736391 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.736594 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.736706 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.736889 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.737016 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.737189 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.737331 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.737486 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.737650 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.737782 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.737952 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.738071 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.738270 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.738355 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.738586 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.738671 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.738893 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.738978 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.739208 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.739292 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.739513 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.739608 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.739857 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.739947 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.740180 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.740265 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.740499 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.740592 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.740808 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.740891 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.741105 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.741188 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.741405 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.741498 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.741705 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.741789 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.742006 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.742090 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.742314 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.742405 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.742616 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.742701 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.742914 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.742998 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.743210 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.743295 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.743510 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.743595 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.743806 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.743902 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.744126 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.744212 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.744425 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.744508 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.744722 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.744807 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.745027 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.745112 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.745322 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.745408 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.745618 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.745702 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.745914 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.746007 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.746210 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.746295 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.746506 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.746599 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.746802 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.746910 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.747101 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.747186 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.747398 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.747492 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.747723 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.747929 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.748048 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.748171 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.748345 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.748448 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.748685 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.748777 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.748947 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.749032 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.749256 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.749351 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.749569 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.749698 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.749880 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.749965 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.750185 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.750271 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.750502 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.750586 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.750803 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.750888 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.751118 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.751211 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.751437 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.751521 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.751778 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.751883 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.752114 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.752201 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.752447 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.752537 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.752752 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.752846 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.753060 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.753151 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.753366 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.753450 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.753666 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.753764 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.753909 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 12:50:34.753995 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.754255 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.754578 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.754906 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.755207 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.755525 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.755863 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.756180 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.756489 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.756795 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.757118 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.757425 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.757730 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.758034 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.758342 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.758649 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.758960 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.759267 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.759575 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.759908 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.760223 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.760549 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.760873 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.761177 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.761499 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.761821 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.762162 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.762475 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.762810 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.763134 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.763502 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.763828 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.764132 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:50:34.764373 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 12:50:34.912953 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: INFO dbcounter [None req-c0887d04-779e-4230-9699-0b7a7d4e7ec0 None None] Registered counter for database nova_api Aug 31 12:50:34.916142 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: INFO dbcounter [None req-49e122c0-9e8b-45da-8d5d-b9c3620f027a None None] Registered counter for database nova_api Aug 31 12:50:34.935988 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG oslo_db.sqlalchemy.engines [None req-c0887d04-779e-4230-9699-0b7a7d4e7ec0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105524) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:50:34.937868 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG oslo_db.sqlalchemy.engines [None req-49e122c0-9e8b-45da-8d5d-b9c3620f027a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105525) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:50:34.943058 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG dbcounter [-] [105524] Writer thread running {{(pid=105524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:50:34.944865 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG dbcounter [-] [105525] Writer thread running {{(pid=105525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:50:34.999604 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.context [None req-c0887d04-779e-4230-9699-0b7a7d4e7ec0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a934bcd7-fa17-435e-9285-cae87d73e85f(cell1) {{(pid=105524) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 12:50:35.000460 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.context [None req-49e122c0-9e8b-45da-8d5d-b9c3620f027a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a934bcd7-fa17-435e-9285-cae87d73e85f(cell1) {{(pid=105525) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 12:50:35.003386 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-c0887d04-779e-4230-9699-0b7a7d4e7ec0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:50:35.003870 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-c0887d04-779e-4230-9699-0b7a7d4e7ec0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:50:35.004239 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG oslo_concurrency.lockutils [None req-49e122c0-9e8b-45da-8d5d-b9c3620f027a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:50:35.004699 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG oslo_concurrency.lockutils [None req-49e122c0-9e8b-45da-8d5d-b9c3620f027a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:50:35.005434 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-c0887d04-779e-4230-9699-0b7a7d4e7ec0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:50:35.006170 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-c0887d04-779e-4230-9699-0b7a7d4e7ec0 None None] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:50:35.006361 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG oslo_concurrency.lockutils [None req-49e122c0-9e8b-45da-8d5d-b9c3620f027a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:50:35.006609 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-c0887d04-779e-4230-9699-0b7a7d4e7ec0 None None] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:50:35.006929 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG oslo_concurrency.lockutils [None req-49e122c0-9e8b-45da-8d5d-b9c3620f027a None None] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:50:35.007371 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG oslo_concurrency.lockutils [None req-49e122c0-9e8b-45da-8d5d-b9c3620f027a None None] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:50:35.008622 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-c0887d04-779e-4230-9699-0b7a7d4e7ec0 None None] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:50:35.009357 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG oslo_concurrency.lockutils [None req-49e122c0-9e8b-45da-8d5d-b9c3620f027a None None] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:50:35.010604 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: INFO dbcounter [None req-c0887d04-779e-4230-9699-0b7a7d4e7ec0 None None] Registered counter for database nova_cell0 Aug 31 12:50:35.011307 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: INFO dbcounter [None req-49e122c0-9e8b-45da-8d5d-b9c3620f027a None None] Registered counter for database nova_cell0 Aug 31 12:50:35.014633 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: INFO dbcounter [None req-c0887d04-779e-4230-9699-0b7a7d4e7ec0 None None] Registered counter for database nova_cell1 Aug 31 12:50:35.015343 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: INFO dbcounter [None req-49e122c0-9e8b-45da-8d5d-b9c3620f027a None None] Registered counter for database nova_cell1 Aug 31 12:50:35.022716 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG oslo_db.sqlalchemy.engines [None req-c0887d04-779e-4230-9699-0b7a7d4e7ec0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105524) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:50:35.026352 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG oslo_db.sqlalchemy.engines [None req-49e122c0-9e8b-45da-8d5d-b9c3620f027a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105525) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:50:35.027561 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG dbcounter [-] [105524] Writer thread running {{(pid=105524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:50:35.030524 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG oslo_db.sqlalchemy.engines [None req-49e122c0-9e8b-45da-8d5d-b9c3620f027a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105525) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:50:35.032096 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG dbcounter [-] [105525] Writer thread running {{(pid=105525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:50:35.159002 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG oslo_db.sqlalchemy.engines [None req-c0887d04-779e-4230-9699-0b7a7d4e7ec0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105524) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:50:35.164697 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG dbcounter [-] [105524] Writer thread running {{(pid=105524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:50:35.166939 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG dbcounter [-] [105525] Writer thread running {{(pid=105525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:50:35.174006 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: INFO dbcounter [None req-c0887d04-779e-4230-9699-0b7a7d4e7ec0 None None] Registered counter for database nova_cell0 Aug 31 12:50:35.175996 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: INFO dbcounter [None req-49e122c0-9e8b-45da-8d5d-b9c3620f027a None None] Registered counter for database nova_cell0 Aug 31 12:50:35.184913 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG oslo_db.sqlalchemy.engines [None req-c0887d04-779e-4230-9699-0b7a7d4e7ec0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105524) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:50:35.186642 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG oslo_db.sqlalchemy.engines [None req-49e122c0-9e8b-45da-8d5d-b9c3620f027a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105525) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:50:35.190140 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG dbcounter [-] [105524] Writer thread running {{(pid=105524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:50:35.191483 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG dbcounter [-] [105525] Writer thread running {{(pid=105525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:50:35.523711 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: WARNING keystonemiddleware.auth_token [None req-c0887d04-779e-4230-9699-0b7a7d4e7ec0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 12:50:35.524542 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: WARNING keystonemiddleware.auth_token [None req-49e122c0-9e8b-45da-8d5d-b9c3620f027a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 12:50:35.531092 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: WARNING keystonemiddleware.auth_token [None req-c0887d04-779e-4230-9699-0b7a7d4e7ec0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 12:50:35.531851 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: WARNING keystonemiddleware.auth_token [None req-49e122c0-9e8b-45da-8d5d-b9c3620f027a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 12:50:35.868648 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: WARNING keystonemiddleware.auth_token [None req-49e122c0-9e8b-45da-8d5d-b9c3620f027a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 12:50:35.871323 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: WARNING keystonemiddleware.auth_token [None req-c0887d04-779e-4230-9699-0b7a7d4e7ec0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 12:50:35.874600 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: WARNING keystonemiddleware.auth_token [None req-49e122c0-9e8b-45da-8d5d-b9c3620f027a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 12:50:35.877582 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: WARNING keystonemiddleware.auth_token [None req-c0887d04-779e-4230-9699-0b7a7d4e7ec0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 12:50:35.879904 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c8c951a9c0 pid: 105525 (default app) Aug 31 12:50:35.881978 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-49e122c0-9e8b-45da-8d5d-b9c3620f027a None None] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:50:35.883030 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c8c951a9c0 pid: 105524 (default app) Aug 31 12:50:35.883159 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-49e122c0-9e8b-45da-8d5d-b9c3620f027a None None] 10.222.0.58 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001725 Aug 31 12:50:35.883549 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 1/1] 10.222.0.58 () {50 vars in 788 bytes} [Wed Aug 31 12:50:35 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:51:53.923370 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-c0887d04-779e-4230-9699-0b7a7d4e7ec0 None None] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:51:53.925541 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-c0887d04-779e-4230-9699-0b7a7d4e7ec0 None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003077 Aug 31 12:51:53.928694 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 1/2] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 31 12:51:53 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:51:53.942287 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG dbcounter [-] [105525] Writing DB stats nova_api:SELECT=3 {{(pid=105525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:51:53.943381 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG dbcounter [-] [105525] Writing DB stats nova_cell1:SELECT=3 {{(pid=105525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:51:53.944672 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG dbcounter [-] [105525] Writing DB stats nova_cell0:SELECT=3 {{(pid=105525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:51:53.945677 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG dbcounter [-] [105525] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:51:54.858117 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-83f47f12-c5f2-40ee-80c9-b7bf5f0f4124 admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:51:54.890436 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-83f47f12-c5f2-40ee-80c9-b7bf5f0f4124 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.957675 Aug 31 12:51:54.891349 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 2/3] 10.222.0.58 () {60 vars in 1292 bytes} [Wed Aug 31 12:51:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:51:57.257909 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-c0887d04-779e-4230-9699-0b7a7d4e7ec0 None None] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:51:57.258921 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-c0887d04-779e-4230-9699-0b7a7d4e7ec0 None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Aug 31 12:51:57.259504 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 2/4] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 31 12:51:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:51:57.685232 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-ea58bde2-7a20-49d0-9a03-68ba189d70e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "os-flavor-access:is_public": true, "ram": 256, "vcpus": 1, "rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "cirros256"}} {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:51:57.736729 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-ea58bde2-7a20-49d0-9a03-68ba189d70e2 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.471185 Aug 31 12:51:57.737619 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 3/5] 10.222.0.58 () {64 vars in 1283 bytes} [Wed Aug 31 12:51:57 2022] POST /compute/v2.1/flavors => generated 407 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:51:57.752320 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG dbcounter [-] [105524] Writing DB stats nova_api:SELECT=3 {{(pid=105524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:51:57.753306 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG dbcounter [-] [105524] Writing DB stats nova_cell1:SELECT=3 {{(pid=105524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:51:57.754446 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG dbcounter [-] [105524] Writing DB stats nova_cell0:SELECT=3 {{(pid=105524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:51:57.755540 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG dbcounter [-] [105524] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:51:57.987486 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-e2df6fa0-a538-449a-a4be-421da0a8f451 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:51:58.049792 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-e2df6fa0-a538-449a-a4be-421da0a8f451 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.303162 Aug 31 12:51:58.050382 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 3/6] 10.222.0.58 () {64 vars in 1336 bytes} [Wed Aug 31 12:51:57 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:52:00.342857 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-ea58bde2-7a20-49d0-9a03-68ba189d70e2 admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:52:00.343890 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-ea58bde2-7a20-49d0-9a03-68ba189d70e2 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002187 Aug 31 12:52:00.344587 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 4/7] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 31 12:52:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:52:00.997933 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-1c27f099-0f1c-4635-b7e4-972f61738e04 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "id": "d1", "vcpus": 1, "rxtx_factor": 1.0, "disk": 5, "os-flavor-access:is_public": true, "ram": 512}} {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:52:01.038161 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-1c27f099-0f1c-4635-b7e4-972f61738e04 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.687359 Aug 31 12:52:01.038723 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 4/8] 10.222.0.58 () {64 vars in 1283 bytes} [Wed Aug 31 12:52:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:52:01.051464 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-7e1a3fc5-a3ff-4174-9bb8-665b8649a006 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:52:01.089212 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-7e1a3fc5-a3ff-4174-9bb8-665b8649a006 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041757 Aug 31 12:52:01.090177 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 5/9] 10.222.0.58 () {64 vars in 1336 bytes} [Wed Aug 31 12:52:01 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:52:03.421866 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-1c27f099-0f1c-4635-b7e4-972f61738e04 admin admin] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:52:03.422880 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-1c27f099-0f1c-4635-b7e4-972f61738e04 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001757 Aug 31 12:52:03.423263 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 5/10] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 31 12:52:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:52:03.826035 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-b40952a8-04da-4301-bfbf-2a6d8cd3e013 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "id": "d2", "ram": 1024, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:52:03.845707 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-b40952a8-04da-4301-bfbf-2a6d8cd3e013 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.416203 Aug 31 12:52:03.846273 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 6/11] 10.222.0.58 () {64 vars in 1283 bytes} [Wed Aug 31 12:52:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:52:03.858431 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-2f13b60d-6419-4978-be39-f780ff1aea25 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:52:03.882666 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-2f13b60d-6419-4978-be39-f780ff1aea25 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028002 Aug 31 12:52:03.883224 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 6/12] 10.222.0.58 () {64 vars in 1336 bytes} [Wed Aug 31 12:52:03 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:52:06.212914 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-b40952a8-04da-4301-bfbf-2a6d8cd3e013 admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:52:06.215864 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-b40952a8-04da-4301-bfbf-2a6d8cd3e013 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002610 Aug 31 12:52:06.216712 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 7/13] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 31 12:52:06 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:52:06.674626 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-73e3c8d9-86d7-4f60-9dca-0615fdf05f37 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "ram": 2048, "vcpus": 2, "disk": 10, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:52:06.698774 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-73e3c8d9-86d7-4f60-9dca-0615fdf05f37 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.472453 Aug 31 12:52:06.700004 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 7/14] 10.222.0.58 () {64 vars in 1283 bytes} [Wed Aug 31 12:52:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:52:06.711649 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-d011d408-41cc-4522-9f9a-3152a8e0dac9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:52:06.738818 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-d011d408-41cc-4522-9f9a-3152a8e0dac9 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030931 Aug 31 12:52:06.739900 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 8/15] 10.222.0.58 () {64 vars in 1336 bytes} [Wed Aug 31 12:52:06 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:52:09.067628 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-73e3c8d9-86d7-4f60-9dca-0615fdf05f37 admin admin] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:52:09.069296 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-73e3c8d9-86d7-4f60-9dca-0615fdf05f37 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002160 Aug 31 12:52:09.069662 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 8/16] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 31 12:52:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:52:09.493895 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-bf66dd06-61eb-45d7-8cf8-a4b860789c29 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 4096, "id": "d4", "os-flavor-access:is_public": true, "swap": 0, "disk": 20, "vcpus": 4, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:52:09.515380 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-bf66dd06-61eb-45d7-8cf8-a4b860789c29 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.439059 Aug 31 12:52:09.524571 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 9/17] 10.222.0.58 () {64 vars in 1283 bytes} [Wed Aug 31 12:52:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:52:09.528879 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-03563abe-195b-4333-827c-5857ba006fdb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:52:09.556058 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-03563abe-195b-4333-827c-5857ba006fdb admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031253 Aug 31 12:52:09.557207 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 9/18] 10.222.0.58 () {64 vars in 1336 bytes} [Wed Aug 31 12:52:09 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:52:11.872341 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-bf66dd06-61eb-45d7-8cf8-a4b860789c29 admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:52:11.873360 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-bf66dd06-61eb-45d7-8cf8-a4b860789c29 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Aug 31 12:52:11.873743 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 10/19] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 31 12:52:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:52:12.308842 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-e3e1c6ae-fa77-4eee-9ebc-1a467984cdea admin admin] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:52:12.335403 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-e3e1c6ae-fa77-4eee-9ebc-1a467984cdea admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.455377 Aug 31 12:52:12.336027 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 10/20] 10.222.0.58 () {60 vars in 1292 bytes} [Wed Aug 31 12:52:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:52:15.178957 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-bf66dd06-61eb-45d7-8cf8-a4b860789c29 admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:52:15.180022 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-bf66dd06-61eb-45d7-8cf8-a4b860789c29 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 31 12:52:15.180735 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 11/21] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 31 12:52:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:52:15.616722 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-dcf4f2eb-55f3-4fd1-bb2d-4c1da4caf6ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.tiny", "rxtx_factor": 1.0, "id": "1", "ram": 512, "os-flavor-access:is_public": true, "disk": 1}} {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:52:15.638635 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-dcf4f2eb-55f3-4fd1-bb2d-4c1da4caf6ab admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.451640 Aug 31 12:52:15.639469 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 11/22] 10.222.0.58 () {64 vars in 1283 bytes} [Wed Aug 31 12:52:15 2022] POST /compute/v2.1/flavors => generated 402 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:52:15.654659 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-3564d9b7-e0af-44a7-a689-de46fdbb2a0f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:52:15.680007 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-3564d9b7-e0af-44a7-a689-de46fdbb2a0f admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029068 Aug 31 12:52:15.680584 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 12/23] 10.222.0.58 () {64 vars in 1333 bytes} [Wed Aug 31 12:52:15 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:52:17.980380 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-dcf4f2eb-55f3-4fd1-bb2d-4c1da4caf6ab admin admin] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:52:17.981296 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-dcf4f2eb-55f3-4fd1-bb2d-4c1da4caf6ab admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Aug 31 12:52:17.981696 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 12/24] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 31 12:52:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:52:18.389444 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-8fd2b6a9-0877-41c2-a886-163ae576f5f6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "ram": 2048, "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.small", "rxtx_factor": 1.0, "id": "2"}} {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:52:18.409713 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-8fd2b6a9-0877-41c2-a886-163ae576f5f6 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.421985 Aug 31 12:52:18.410282 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 13/25] 10.222.0.58 () {64 vars in 1283 bytes} [Wed Aug 31 12:52:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:52:18.422488 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-a5e78d4e-c4e1-4121-b6b2-0640b6ba1b7e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:52:18.446878 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-a5e78d4e-c4e1-4121-b6b2-0640b6ba1b7e admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028341 Aug 31 12:52:18.447765 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 13/26] 10.222.0.58 () {64 vars in 1333 bytes} [Wed Aug 31 12:52:18 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:52:20.822323 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-8fd2b6a9-0877-41c2-a886-163ae576f5f6 admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:52:20.823318 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-8fd2b6a9-0877-41c2-a886-163ae576f5f6 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Aug 31 12:52:20.823731 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 14/27] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 31 12:52:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:52:21.337589 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-05fe55c7-f203-4c40-8873-85e0de3bac77 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "name": "m1.medium", "swap": 0, "vcpus": 2, "disk": 40, "os-flavor-access:is_public": true, "ram": 4096}} {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:52:21.359532 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-05fe55c7-f203-4c40-8873-85e0de3bac77 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.529058 Aug 31 12:52:21.365427 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 14/28] 10.222.0.58 () {64 vars in 1283 bytes} [Wed Aug 31 12:52:20 2022] POST /compute/v2.1/flavors => generated 406 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:52:21.373450 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-e7b50f95-719f-431c-ab64-6bd78515f34a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:52:21.400410 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-e7b50f95-719f-431c-ab64-6bd78515f34a admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030640 Aug 31 12:52:21.401272 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 15/29] 10.222.0.58 () {64 vars in 1333 bytes} [Wed Aug 31 12:52:21 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:52:23.777816 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-05fe55c7-f203-4c40-8873-85e0de3bac77 admin admin] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:52:23.779506 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-05fe55c7-f203-4c40-8873-85e0de3bac77 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002129 Aug 31 12:52:23.779944 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 15/30] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 31 12:52:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:52:24.234918 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-bbe0e9f8-d0b0-4f33-a3d1-09cf4ba90572 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 8192, "disk": 80, "vcpus": 4, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "swap": 0}} {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:52:24.244879 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG dbcounter [-] [105525] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:52:24.263509 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-bbe0e9f8-d0b0-4f33-a3d1-09cf4ba90572 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.476904 Aug 31 12:52:24.264387 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 16/31] 10.222.0.58 () {64 vars in 1283 bytes} [Wed Aug 31 12:52:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:52:24.279210 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-ae119d76-a894-4053-82ec-66db3ef52681 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:52:24.304871 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-ae119d76-a894-4053-82ec-66db3ef52681 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031824 Aug 31 12:52:24.305877 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 16/32] 10.222.0.58 () {64 vars in 1333 bytes} [Wed Aug 31 12:52:24 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:52:26.645734 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-bbe0e9f8-d0b0-4f33-a3d1-09cf4ba90572 admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:52:26.646652 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-bbe0e9f8-d0b0-4f33-a3d1-09cf4ba90572 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Aug 31 12:52:26.647208 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 17/33] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 31 12:52:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:52:27.090038 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-38dc07a1-cf0d-4579-894f-33407249a033 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "name": "m1.xlarge", "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "os-flavor-access:is_public": true, "disk": 160, "rxtx_factor": 1.0, "swap": 0}} {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:52:27.113496 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-38dc07a1-cf0d-4579-894f-33407249a033 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.459790 Aug 31 12:52:27.114378 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 17/34] 10.222.0.58 () {64 vars in 1283 bytes} [Wed Aug 31 12:52:26 2022] POST /compute/v2.1/flavors => generated 408 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:52:27.127889 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-cfa26ffb-c8da-49bb-8ac8-4eb7f50a28eb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:52:27.153070 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-cfa26ffb-c8da-49bb-8ac8-4eb7f50a28eb admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030137 Aug 31 12:52:27.153654 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 18/35] 10.222.0.58 () {64 vars in 1333 bytes} [Wed Aug 31 12:52:27 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:52:45.858725 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-38dc07a1-cf0d-4579-894f-33407249a033 admin admin] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:52:45.860069 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-38dc07a1-cf0d-4579-894f-33407249a033 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001967 Aug 31 12:52:45.860766 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 18/36] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 31 12:52:45 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:52:45.871497 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG dbcounter [-] [105525] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:52:46.316347 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-640a60da-57c2-4750-be93-c284c0bbc908 admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:52:46.336116 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-640a60da-57c2-4750-be93-c284c0bbc908 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.469126 Aug 31 12:52:46.336654 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 19/37] 10.222.0.58 () {60 vars in 1292 bytes} [Wed Aug 31 12:52:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:52:47.406200 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-38dc07a1-cf0d-4579-894f-33407249a033 admin admin] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:52:47.407524 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-38dc07a1-cf0d-4579-894f-33407249a033 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001873 Aug 31 12:52:47.408044 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 19/38] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Aug 31 12:52:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:52:47.981504 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-55afaa31-0ab0-43fb-adbf-679efae18962 admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:52:47.987506 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.wsgi [None req-55afaa31-0ab0-43fb-adbf-679efae18962 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 12:52:47.990873 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-55afaa31-0ab0-43fb-adbf-679efae18962 admin admin] Request method failure captured: Aug 31 12:52:47.990873 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 31 12:52:47.990873 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: Accept: application/json Aug 31 12:52:47.990873 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: Accept-Encoding: gzip, deflate Aug 31 12:52:47.990873 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: Connection: keep-alive Aug 31 12:52:47.990873 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: Content-Length: 0 Aug 31 12:52:47.990873 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: Host: 10.222.0.58 Aug 31 12:52:47.990873 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: Openstack-Api-Version: compute 2.90 Aug 31 12:52:47.990873 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: Openstack-System-Scope: None Aug 31 12:52:47.990873 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: User-Agent: python-novaclient Aug 31 12:52:47.990873 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Auth-Token: gAAAAABjD1mfKy6D7bACk62_3eInl7S-gLCmKh7cveNA3-LOJV0qsdlBsQUgCZPlWrZR7_ySKIRXwrRclbQ-SHASOOTyv7Q2qRRO9niX3LkeE5KTKGld7uqLv1wqhcdfvupsWelEjKuKc5BdIitT0XBtl8b82UIpuTLsWgdcePQbNL3EqtvvsKo Aug 31 12:52:47.990873 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Domain-Id: None Aug 31 12:52:47.990873 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Domain-Name: None Aug 31 12:52:47.990873 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Identity-Status: Confirmed Aug 31 12:52:47.990873 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Is-Admin-Project: True Aug 31 12:52:47.990873 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 12:52:47.990873 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Project-Domain-Id: default Aug 31 12:52:47.990873 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Project-Domain-Name: Default Aug 31 12:52:47.990873 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Project-Id: 27a1c540ff93405e831b4db6db04dca6 Aug 31 12:52:47.990873 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Project-Name: admin Aug 31 12:52:47.990873 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Role: reader,member,admin Aug 31 12:52:47.990873 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Roles: reader,member,admin Aug 31 12:52:47.993168 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_27a1c540ff93405e831b4db6db04dca6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27a1c540ff93405e831b4db6db04dca6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27a1c540ff93405e831b4db6db04dca6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/27a1c540ff93405e831b4db6db04dca6"}]}] Aug 31 12:52:47.993168 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Tenant: admin Aug 31 12:52:47.993168 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Tenant-Id: 27a1c540ff93405e831b4db6db04dca6 Aug 31 12:52:47.993168 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Tenant-Name: admin Aug 31 12:52:47.993168 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-User: admin Aug 31 12:52:47.993168 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-User-Domain-Id: default Aug 31 12:52:47.993168 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-User-Domain-Name: Default Aug 31 12:52:47.993168 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-User-Id: 6ccf24e2ff3940a281ca14d940b55349 Aug 31 12:52:47.993168 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-User-Name: admin Aug 31 12:52:47.993168 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: method: > Aug 31 12:52:47.993168 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: exception: Flavor 42 could not be found. Aug 31 12:52:47.993168 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: action_args: {'id': '42'} Aug 31 12:52:47.993168 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:52:47.993168 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:52:47.994127 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 12:52:47.994127 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 12:52:47.994127 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 12:52:47.994127 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 12:52:47.994127 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 12:52:47.994127 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 12:52:47.994127 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 12:52:47.994127 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 12:52:47.994127 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 12:52:47.994127 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:52:47.994127 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 12:52:47.994127 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 12:52:47.994127 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 31 12:52:47.994127 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Aug 31 12:52:47.994127 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:52:47.994127 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Aug 31 12:52:47.994127 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:52:47.994127 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:52:47.994127 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:52:47.995251 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:52:47.995251 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:52:47.995251 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:52:47.995251 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:52:47.995251 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 12:52:47.995251 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:52:47.995251 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 31 12:52:47.995251 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Aug 31 12:52:47.995251 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:52:47.995251 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Aug 31 12:52:47.995251 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:52:47.995251 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:52:47.995251 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:52:47.995251 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:52:47.995251 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:52:47.995251 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 31 12:52:47.995251 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Aug 31 12:52:47.995251 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-55afaa31-0ab0-43fb-adbf-679efae18962 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:52:47.996397 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-55afaa31-0ab0-43fb-adbf-679efae18962 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.438984 Aug 31 12:52:47.996397 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 20/39] 10.222.0.58 () {60 vars in 1190 bytes} [Wed Aug 31 12:52:47 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 441 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 12:52:48.003517 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-706ad465-15ea-4cda-a41c-42ff4bf35a15 admin admin] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:52:48.007866 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG dbcounter [-] [105524] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:52:48.040049 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-706ad465-15ea-4cda-a41c-42ff4bf35a15 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.039707 Aug 31 12:52:48.040900 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 20/40] 10.222.0.58 () {60 vars in 1210 bytes} [Wed Aug 31 12:52:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:52:48.054006 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-3bb3541c-3dda-462c-8b93-07c4ac909795 admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:52:48.076821 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-3bb3541c-3dda-462c-8b93-07c4ac909795 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026436 Aug 31 12:52:48.077360 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 21/41] 10.222.0.58 () {60 vars in 1210 bytes} [Wed Aug 31 12:52:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:52:48.087505 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-29d1e883-74ca-4884-8928-f3e7f30ebb3f admin admin] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:52:48.093848 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.wsgi [None req-29d1e883-74ca-4884-8928-f3e7f30ebb3f admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 12:52:48.097266 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-29d1e883-74ca-4884-8928-f3e7f30ebb3f admin admin] Request method failure captured: Aug 31 12:52:48.097266 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 31 12:52:48.097266 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: Accept: application/json Aug 31 12:52:48.097266 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: Accept-Encoding: gzip, deflate Aug 31 12:52:48.097266 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: Connection: keep-alive Aug 31 12:52:48.097266 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: Content-Length: 0 Aug 31 12:52:48.097266 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: Host: 10.222.0.58 Aug 31 12:52:48.097266 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: Openstack-Api-Version: compute 2.90 Aug 31 12:52:48.097266 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: Openstack-System-Scope: None Aug 31 12:52:48.097266 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: User-Agent: python-novaclient Aug 31 12:52:48.097266 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Auth-Token: gAAAAABjD1mfKy6D7bACk62_3eInl7S-gLCmKh7cveNA3-LOJV0qsdlBsQUgCZPlWrZR7_ySKIRXwrRclbQ-SHASOOTyv7Q2qRRO9niX3LkeE5KTKGld7uqLv1wqhcdfvupsWelEjKuKc5BdIitT0XBtl8b82UIpuTLsWgdcePQbNL3EqtvvsKo Aug 31 12:52:48.097266 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Domain-Id: None Aug 31 12:52:48.097266 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Domain-Name: None Aug 31 12:52:48.097266 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Identity-Status: Confirmed Aug 31 12:52:48.097266 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Is-Admin-Project: True Aug 31 12:52:48.097266 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 12:52:48.097266 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Project-Domain-Id: default Aug 31 12:52:48.097266 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Project-Domain-Name: Default Aug 31 12:52:48.097266 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Project-Id: 27a1c540ff93405e831b4db6db04dca6 Aug 31 12:52:48.097266 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Project-Name: admin Aug 31 12:52:48.097266 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Role: reader,member,admin Aug 31 12:52:48.097266 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Roles: reader,member,admin Aug 31 12:52:48.098761 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_27a1c540ff93405e831b4db6db04dca6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27a1c540ff93405e831b4db6db04dca6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27a1c540ff93405e831b4db6db04dca6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/27a1c540ff93405e831b4db6db04dca6"}]}] Aug 31 12:52:48.098761 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Tenant: admin Aug 31 12:52:48.098761 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Tenant-Id: 27a1c540ff93405e831b4db6db04dca6 Aug 31 12:52:48.098761 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Tenant-Name: admin Aug 31 12:52:48.098761 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-User: admin Aug 31 12:52:48.098761 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-User-Domain-Id: default Aug 31 12:52:48.098761 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-User-Domain-Name: Default Aug 31 12:52:48.098761 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-User-Id: 6ccf24e2ff3940a281ca14d940b55349 Aug 31 12:52:48.098761 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-User-Name: admin Aug 31 12:52:48.098761 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: method: > Aug 31 12:52:48.098761 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: exception: Flavor 42 could not be found. Aug 31 12:52:48.098761 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: action_args: {'id': '42'} Aug 31 12:52:48.098761 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:52:48.098761 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:52:48.099730 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 12:52:48.099730 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 12:52:48.099730 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 12:52:48.099730 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 12:52:48.099730 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 12:52:48.099730 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 12:52:48.099730 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 12:52:48.099730 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 12:52:48.099730 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 12:52:48.099730 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:52:48.099730 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 12:52:48.099730 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 12:52:48.099730 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 31 12:52:48.099730 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Aug 31 12:52:48.099730 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:52:48.099730 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Aug 31 12:52:48.099730 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:52:48.099730 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:52:48.099730 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:52:48.100911 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:52:48.100911 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:52:48.100911 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:52:48.100911 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:52:48.100911 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 12:52:48.100911 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:52:48.100911 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 31 12:52:48.100911 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Aug 31 12:52:48.100911 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:52:48.100911 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Aug 31 12:52:48.100911 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:52:48.100911 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:52:48.100911 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:52:48.100911 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:52:48.100911 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:52:48.100911 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 31 12:52:48.100911 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Aug 31 12:52:48.100911 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-29d1e883-74ca-4884-8928-f3e7f30ebb3f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:52:48.101965 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-29d1e883-74ca-4884-8928-f3e7f30ebb3f admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015203 Aug 31 12:52:48.101965 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 21/42] 10.222.0.58 () {60 vars in 1190 bytes} [Wed Aug 31 12:52:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 12:52:49.056934 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-3bb3541c-3dda-462c-8b93-07c4ac909795 admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:52:49.058274 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-3bb3541c-3dda-462c-8b93-07c4ac909795 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002070 Aug 31 12:52:49.058806 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 22/43] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Aug 31 12:52:49 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:52:49.616688 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-b5a2b276-bc84-4582-ab45-fd9a3e489ebb admin admin] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:52:49.622361 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.wsgi [None req-b5a2b276-bc84-4582-ab45-fd9a3e489ebb admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 12:52:49.623861 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-b5a2b276-bc84-4582-ab45-fd9a3e489ebb admin admin] Request method failure captured: Aug 31 12:52:49.623861 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 31 12:52:49.623861 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: Accept: application/json Aug 31 12:52:49.623861 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: Accept-Encoding: gzip, deflate Aug 31 12:52:49.623861 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: Connection: keep-alive Aug 31 12:52:49.623861 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: Content-Length: 0 Aug 31 12:52:49.623861 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: Host: 10.222.0.58 Aug 31 12:52:49.623861 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: Openstack-Api-Version: compute 2.90 Aug 31 12:52:49.623861 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: Openstack-System-Scope: None Aug 31 12:52:49.623861 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: User-Agent: python-novaclient Aug 31 12:52:49.623861 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Auth-Token: gAAAAABjD1mgUkK1EzbD8oG-wEjTHmEqH7FicmclUaAq5FwFxSNmsD81mISzbMfCd3X_9On7DRYGGyiLW3XkeQeKJZw58L29CoTwPQl0yHbkDnH4LnIVAo4ds43RDjS2jK5I26JHxT0ZecOMsrFCmTHr8o45jkKsiJWOuKDj2M8ehBs-BdsyCtc Aug 31 12:52:49.623861 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Domain-Id: None Aug 31 12:52:49.623861 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Domain-Name: None Aug 31 12:52:49.623861 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Identity-Status: Confirmed Aug 31 12:52:49.623861 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Is-Admin-Project: True Aug 31 12:52:49.623861 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 12:52:49.623861 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Project-Domain-Id: default Aug 31 12:52:49.623861 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Project-Domain-Name: Default Aug 31 12:52:49.623861 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Project-Id: 27a1c540ff93405e831b4db6db04dca6 Aug 31 12:52:49.623861 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Project-Name: admin Aug 31 12:52:49.623861 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Role: reader,member,admin Aug 31 12:52:49.623861 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Roles: reader,member,admin Aug 31 12:52:49.625312 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_27a1c540ff93405e831b4db6db04dca6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27a1c540ff93405e831b4db6db04dca6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27a1c540ff93405e831b4db6db04dca6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/27a1c540ff93405e831b4db6db04dca6"}]}] Aug 31 12:52:49.625312 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Tenant: admin Aug 31 12:52:49.625312 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Tenant-Id: 27a1c540ff93405e831b4db6db04dca6 Aug 31 12:52:49.625312 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Tenant-Name: admin Aug 31 12:52:49.625312 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-User: admin Aug 31 12:52:49.625312 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-User-Domain-Id: default Aug 31 12:52:49.625312 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-User-Domain-Name: Default Aug 31 12:52:49.625312 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-User-Id: 6ccf24e2ff3940a281ca14d940b55349 Aug 31 12:52:49.625312 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-User-Name: admin Aug 31 12:52:49.625312 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: method: > Aug 31 12:52:49.625312 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: exception: Flavor 84 could not be found. Aug 31 12:52:49.625312 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: action_args: {'id': '84'} Aug 31 12:52:49.625312 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:52:49.625312 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:52:49.626194 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 12:52:49.626194 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 12:52:49.626194 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 12:52:49.626194 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 12:52:49.626194 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 12:52:49.626194 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 12:52:49.626194 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 12:52:49.626194 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 12:52:49.626194 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 12:52:49.626194 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:52:49.626194 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 12:52:49.626194 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 12:52:49.626194 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 31 12:52:49.626194 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Aug 31 12:52:49.626194 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:52:49.626194 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Aug 31 12:52:49.626194 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:52:49.626194 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:52:49.626194 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:52:49.627227 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:52:49.627227 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:52:49.627227 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:52:49.627227 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:52:49.627227 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 12:52:49.627227 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:52:49.627227 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 31 12:52:49.627227 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Aug 31 12:52:49.627227 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:52:49.627227 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Aug 31 12:52:49.627227 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:52:49.627227 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:52:49.627227 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:52:49.627227 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:52:49.627227 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:52:49.627227 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 31 12:52:49.627227 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Aug 31 12:52:49.627227 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-b5a2b276-bc84-4582-ab45-fd9a3e489ebb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:52:49.628292 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-b5a2b276-bc84-4582-ab45-fd9a3e489ebb admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.430028 Aug 31 12:52:49.628292 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 22/44] 10.222.0.58 () {60 vars in 1190 bytes} [Wed Aug 31 12:52:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 431 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 12:52:49.634859 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-83db0a3f-2a7a-4368-9dd8-a381e68e5c37 admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:52:49.650261 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-83db0a3f-2a7a-4368-9dd8-a381e68e5c37 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019025 Aug 31 12:52:49.650781 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 23/45] 10.222.0.58 () {60 vars in 1210 bytes} [Wed Aug 31 12:52:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:52:49.660041 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-cb877526-5f80-47b1-ab30-a64363f643ac admin admin] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:52:49.675175 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-cb877526-5f80-47b1-ab30-a64363f643ac admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018609 Aug 31 12:52:49.675701 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 23/46] 10.222.0.58 () {60 vars in 1210 bytes} [Wed Aug 31 12:52:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:52:49.684902 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-010ed977-cc57-495d-bca2-810e4168aaa9 admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:52:49.690349 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.wsgi [None req-010ed977-cc57-495d-bca2-810e4168aaa9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 12:52:49.691870 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-010ed977-cc57-495d-bca2-810e4168aaa9 admin admin] Request method failure captured: Aug 31 12:52:49.691870 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 31 12:52:49.691870 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: Accept: application/json Aug 31 12:52:49.691870 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: Accept-Encoding: gzip, deflate Aug 31 12:52:49.691870 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: Connection: keep-alive Aug 31 12:52:49.691870 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: Content-Length: 0 Aug 31 12:52:49.691870 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: Host: 10.222.0.58 Aug 31 12:52:49.691870 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: Openstack-Api-Version: compute 2.90 Aug 31 12:52:49.691870 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: Openstack-System-Scope: None Aug 31 12:52:49.691870 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: User-Agent: python-novaclient Aug 31 12:52:49.691870 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Auth-Token: gAAAAABjD1mgUkK1EzbD8oG-wEjTHmEqH7FicmclUaAq5FwFxSNmsD81mISzbMfCd3X_9On7DRYGGyiLW3XkeQeKJZw58L29CoTwPQl0yHbkDnH4LnIVAo4ds43RDjS2jK5I26JHxT0ZecOMsrFCmTHr8o45jkKsiJWOuKDj2M8ehBs-BdsyCtc Aug 31 12:52:49.691870 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Domain-Id: None Aug 31 12:52:49.691870 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Domain-Name: None Aug 31 12:52:49.691870 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Identity-Status: Confirmed Aug 31 12:52:49.691870 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Is-Admin-Project: True Aug 31 12:52:49.691870 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 12:52:49.691870 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Project-Domain-Id: default Aug 31 12:52:49.691870 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Project-Domain-Name: Default Aug 31 12:52:49.691870 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Project-Id: 27a1c540ff93405e831b4db6db04dca6 Aug 31 12:52:49.691870 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Project-Name: admin Aug 31 12:52:49.691870 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Role: reader,member,admin Aug 31 12:52:49.691870 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Roles: reader,member,admin Aug 31 12:52:49.693256 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_27a1c540ff93405e831b4db6db04dca6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27a1c540ff93405e831b4db6db04dca6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27a1c540ff93405e831b4db6db04dca6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/27a1c540ff93405e831b4db6db04dca6"}]}] Aug 31 12:52:49.693256 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Tenant: admin Aug 31 12:52:49.693256 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Tenant-Id: 27a1c540ff93405e831b4db6db04dca6 Aug 31 12:52:49.693256 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Tenant-Name: admin Aug 31 12:52:49.693256 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-User: admin Aug 31 12:52:49.693256 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-User-Domain-Id: default Aug 31 12:52:49.693256 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-User-Domain-Name: Default Aug 31 12:52:49.693256 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-User-Id: 6ccf24e2ff3940a281ca14d940b55349 Aug 31 12:52:49.693256 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-User-Name: admin Aug 31 12:52:49.693256 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: method: > Aug 31 12:52:49.693256 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: exception: Flavor 84 could not be found. Aug 31 12:52:49.693256 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: action_args: {'id': '84'} Aug 31 12:52:49.693256 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:52:49.693256 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:52:49.694283 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 12:52:49.694283 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 12:52:49.694283 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 12:52:49.694283 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 12:52:49.694283 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 12:52:49.694283 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 12:52:49.694283 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 12:52:49.694283 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 12:52:49.694283 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 12:52:49.694283 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:52:49.694283 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 12:52:49.694283 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 12:52:49.694283 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 31 12:52:49.694283 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Aug 31 12:52:49.694283 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:52:49.694283 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Aug 31 12:52:49.694283 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:52:49.694283 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:52:49.694283 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:52:49.695396 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:52:49.695396 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:52:49.695396 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:52:49.695396 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:52:49.695396 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 12:52:49.695396 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:52:49.695396 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 31 12:52:49.695396 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Aug 31 12:52:49.695396 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:52:49.695396 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Aug 31 12:52:49.695396 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:52:49.695396 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:52:49.695396 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:52:49.695396 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:52:49.695396 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:52:49.695396 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 31 12:52:49.695396 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Aug 31 12:52:49.695396 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-010ed977-cc57-495d-bca2-810e4168aaa9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:52:49.696431 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-010ed977-cc57-495d-bca2-810e4168aaa9 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011947 Aug 31 12:52:49.696431 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 24/47] 10.222.0.58 () {60 vars in 1190 bytes} [Wed Aug 31 12:52:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 12:52:50.685397 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-cb877526-5f80-47b1-ab30-a64363f643ac admin admin] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:52:50.686444 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-cb877526-5f80-47b1-ab30-a64363f643ac admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 31 12:52:50.686839 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 24/48] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Aug 31 12:52:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:52:51.248827 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-c5f16d8a-519e-44e4-ac36-70a2d6b51228 admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:52:51.254913 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.wsgi [None req-c5f16d8a-519e-44e4-ac36-70a2d6b51228 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 12:52:51.257788 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-c5f16d8a-519e-44e4-ac36-70a2d6b51228 admin admin] Request method failure captured: Aug 31 12:52:51.257788 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 31 12:52:51.257788 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: Accept: application/json Aug 31 12:52:51.257788 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: Accept-Encoding: gzip, deflate Aug 31 12:52:51.257788 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: Connection: keep-alive Aug 31 12:52:51.257788 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: Content-Length: 0 Aug 31 12:52:51.257788 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: Host: 10.222.0.58 Aug 31 12:52:51.257788 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: Openstack-Api-Version: compute 2.90 Aug 31 12:52:51.257788 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: Openstack-System-Scope: None Aug 31 12:52:51.257788 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: User-Agent: python-novaclient Aug 31 12:52:51.257788 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Auth-Token: gAAAAABjD1mi7EwUv1IoCEMzM41lmx4kKmkDR2ZCzGbNAjfS44iyX4KZS6F6Bcv51WV8U47dYV25XUW7Qc0j4a9tJcz1WMm1G2k2gBo0UND5jwXvTnn_LNjir49gB-SqZIXENckssbpxQIpV4DTOK47DOC7eyreKvfHUCUBLUUS6n14xL8FoqNA Aug 31 12:52:51.257788 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Domain-Id: None Aug 31 12:52:51.257788 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Domain-Name: None Aug 31 12:52:51.257788 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Identity-Status: Confirmed Aug 31 12:52:51.257788 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Is-Admin-Project: True Aug 31 12:52:51.257788 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 12:52:51.257788 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Project-Domain-Id: default Aug 31 12:52:51.257788 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Project-Domain-Name: Default Aug 31 12:52:51.257788 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Project-Id: 27a1c540ff93405e831b4db6db04dca6 Aug 31 12:52:51.257788 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Project-Name: admin Aug 31 12:52:51.257788 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Role: reader,member,admin Aug 31 12:52:51.257788 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Roles: reader,member,admin Aug 31 12:52:51.259264 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_27a1c540ff93405e831b4db6db04dca6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27a1c540ff93405e831b4db6db04dca6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27a1c540ff93405e831b4db6db04dca6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/27a1c540ff93405e831b4db6db04dca6"}]}] Aug 31 12:52:51.259264 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Tenant: admin Aug 31 12:52:51.259264 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Tenant-Id: 27a1c540ff93405e831b4db6db04dca6 Aug 31 12:52:51.259264 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-Tenant-Name: admin Aug 31 12:52:51.259264 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-User: admin Aug 31 12:52:51.259264 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-User-Domain-Id: default Aug 31 12:52:51.259264 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-User-Domain-Name: Default Aug 31 12:52:51.259264 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-User-Id: 6ccf24e2ff3940a281ca14d940b55349 Aug 31 12:52:51.259264 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: X-User-Name: admin Aug 31 12:52:51.259264 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: method: > Aug 31 12:52:51.259264 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: exception: Flavor 451 could not be found. Aug 31 12:52:51.259264 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: action_args: {'id': '451'} Aug 31 12:52:51.259264 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:52:51.259264 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:52:51.260330 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 12:52:51.260330 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 12:52:51.260330 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 12:52:51.260330 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 12:52:51.260330 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 12:52:51.260330 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 12:52:51.260330 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 12:52:51.260330 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 12:52:51.260330 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 12:52:51.260330 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:52:51.260330 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 12:52:51.260330 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 12:52:51.260330 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 31 12:52:51.260330 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Aug 31 12:52:51.260330 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:52:51.260330 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Aug 31 12:52:51.260330 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:52:51.260330 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:52:51.260330 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:52:51.261825 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:52:51.261825 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:52:51.261825 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:52:51.261825 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:52:51.261825 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 12:52:51.261825 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:52:51.261825 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 31 12:52:51.261825 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Aug 31 12:52:51.261825 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:52:51.261825 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Aug 31 12:52:51.261825 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:52:51.261825 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:52:51.261825 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:52:51.261825 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:52:51.261825 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:52:51.261825 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 31 12:52:51.261825 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Aug 31 12:52:51.261825 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-c5f16d8a-519e-44e4-ac36-70a2d6b51228 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:52:51.263078 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-c5f16d8a-519e-44e4-ac36-70a2d6b51228 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.435250 Aug 31 12:52:51.263078 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 25/49] 10.222.0.58 () {60 vars in 1193 bytes} [Wed Aug 31 12:52:50 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 437 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 12:52:51.273164 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-bf11ab96-336d-4568-8e13-84b7ce57abd0 admin admin] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:52:51.290149 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-bf11ab96-336d-4568-8e13-84b7ce57abd0 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023228 Aug 31 12:52:51.290775 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 25/50] 10.222.0.58 () {60 vars in 1210 bytes} [Wed Aug 31 12:52:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:52:51.300774 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-50585ab9-a901-4f07-81db-ace8cd96aa1a admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:52:51.315771 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-50585ab9-a901-4f07-81db-ace8cd96aa1a admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018571 Aug 31 12:52:51.316327 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 26/51] 10.222.0.58 () {60 vars in 1210 bytes} [Wed Aug 31 12:52:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:52:51.325877 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-2c491192-f29c-4f74-abb4-d8b4a66882f9 admin admin] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:52:51.331349 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.wsgi [None req-2c491192-f29c-4f74-abb4-d8b4a66882f9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 12:52:51.332877 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-2c491192-f29c-4f74-abb4-d8b4a66882f9 admin admin] Request method failure captured: Aug 31 12:52:51.332877 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 31 12:52:51.332877 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: Accept: application/json Aug 31 12:52:51.332877 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: Accept-Encoding: gzip, deflate Aug 31 12:52:51.332877 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: Connection: keep-alive Aug 31 12:52:51.332877 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: Content-Length: 0 Aug 31 12:52:51.332877 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: Host: 10.222.0.58 Aug 31 12:52:51.332877 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: Openstack-Api-Version: compute 2.90 Aug 31 12:52:51.332877 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: Openstack-System-Scope: None Aug 31 12:52:51.332877 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: User-Agent: python-novaclient Aug 31 12:52:51.332877 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Auth-Token: gAAAAABjD1mi7EwUv1IoCEMzM41lmx4kKmkDR2ZCzGbNAjfS44iyX4KZS6F6Bcv51WV8U47dYV25XUW7Qc0j4a9tJcz1WMm1G2k2gBo0UND5jwXvTnn_LNjir49gB-SqZIXENckssbpxQIpV4DTOK47DOC7eyreKvfHUCUBLUUS6n14xL8FoqNA Aug 31 12:52:51.332877 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Domain-Id: None Aug 31 12:52:51.332877 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Domain-Name: None Aug 31 12:52:51.332877 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Identity-Status: Confirmed Aug 31 12:52:51.332877 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Is-Admin-Project: True Aug 31 12:52:51.332877 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 12:52:51.332877 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Project-Domain-Id: default Aug 31 12:52:51.332877 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Project-Domain-Name: Default Aug 31 12:52:51.332877 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Project-Id: 27a1c540ff93405e831b4db6db04dca6 Aug 31 12:52:51.332877 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Project-Name: admin Aug 31 12:52:51.332877 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Role: reader,member,admin Aug 31 12:52:51.332877 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Roles: reader,member,admin Aug 31 12:52:51.334510 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_27a1c540ff93405e831b4db6db04dca6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27a1c540ff93405e831b4db6db04dca6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27a1c540ff93405e831b4db6db04dca6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/27a1c540ff93405e831b4db6db04dca6"}]}] Aug 31 12:52:51.334510 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Tenant: admin Aug 31 12:52:51.334510 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Tenant-Id: 27a1c540ff93405e831b4db6db04dca6 Aug 31 12:52:51.334510 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-Tenant-Name: admin Aug 31 12:52:51.334510 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-User: admin Aug 31 12:52:51.334510 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-User-Domain-Id: default Aug 31 12:52:51.334510 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-User-Domain-Name: Default Aug 31 12:52:51.334510 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-User-Id: 6ccf24e2ff3940a281ca14d940b55349 Aug 31 12:52:51.334510 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: X-User-Name: admin Aug 31 12:52:51.334510 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: method: > Aug 31 12:52:51.334510 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: exception: Flavor 451 could not be found. Aug 31 12:52:51.334510 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: action_args: {'id': '451'} Aug 31 12:52:51.334510 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:52:51.334510 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:52:51.335312 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 12:52:51.335312 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 12:52:51.335312 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 12:52:51.335312 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 12:52:51.335312 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 12:52:51.335312 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 12:52:51.335312 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 12:52:51.335312 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 12:52:51.335312 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 12:52:51.335312 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:52:51.335312 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 12:52:51.335312 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 12:52:51.335312 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 31 12:52:51.335312 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Aug 31 12:52:51.335312 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:52:51.335312 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Aug 31 12:52:51.335312 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:52:51.335312 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:52:51.335312 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:52:51.336724 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:52:51.336724 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:52:51.336724 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:52:51.336724 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:52:51.336724 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 12:52:51.336724 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:52:51.336724 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 31 12:52:51.336724 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Aug 31 12:52:51.336724 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:52:51.336724 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Aug 31 12:52:51.336724 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:52:51.336724 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:52:51.336724 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:52:51.336724 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:52:51.336724 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:52:51.336724 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 31 12:52:51.336724 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Aug 31 12:52:51.336724 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-2c491192-f29c-4f74-abb4-d8b4a66882f9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:52:51.338064 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-2c491192-f29c-4f74-abb4-d8b4a66882f9 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012080 Aug 31 12:52:51.338064 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 26/52] 10.222.0.58 () {60 vars in 1193 bytes} [Wed Aug 31 12:52:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 12:52:52.335648 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-50585ab9-a901-4f07-81db-ace8cd96aa1a admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:52:52.336743 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-50585ab9-a901-4f07-81db-ace8cd96aa1a admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Aug 31 12:52:52.337140 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 27/53] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Aug 31 12:52:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:52:52.908265 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-7f2d2211-b1c8-44f9-801b-400199faaba8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:52:52.934315 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-7f2d2211-b1c8-44f9-801b-400199faaba8 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.452818 Aug 31 12:52:52.934840 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 27/54] 10.222.0.58 () {64 vars in 1235 bytes} [Wed Aug 31 12:52:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:52:53.906097 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-50585ab9-a901-4f07-81db-ace8cd96aa1a admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:52:53.907400 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-50585ab9-a901-4f07-81db-ace8cd96aa1a admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001894 Aug 31 12:52:53.907957 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 28/55] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Aug 31 12:52:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:52:54.472949 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-a893b974-d42d-4dda-889d-13a7cc367df2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:52:54.494104 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-a893b974-d42d-4dda-889d-13a7cc367df2 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.440314 Aug 31 12:52:54.494654 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 28/56] 10.222.0.58 () {64 vars in 1235 bytes} [Wed Aug 31 12:52:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:52:55.581620 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-50585ab9-a901-4f07-81db-ace8cd96aa1a admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:52:55.582627 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-50585ab9-a901-4f07-81db-ace8cd96aa1a admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Aug 31 12:52:55.583017 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 29/57] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Aug 31 12:52:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:52:56.176121 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-4525dfcd-71fb-435b-aa76-834c5f1b2b35 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:52:56.199374 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-4525dfcd-71fb-435b-aa76-834c5f1b2b35 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.479470 Aug 31 12:52:56.199955 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 29/58] 10.222.0.58 () {64 vars in 1235 bytes} [Wed Aug 31 12:52:55 2022] POST /compute/v2.1/flavors => generated 407 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:52:57.190044 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-50585ab9-a901-4f07-81db-ace8cd96aa1a admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:52:57.191111 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-50585ab9-a901-4f07-81db-ace8cd96aa1a admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 31 12:52:57.191476 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 30/59] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Aug 31 12:52:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:52:57.772129 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-ebda8363-3c4c-45b0-9142-bf5f3b33b40c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:52:57.794405 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-ebda8363-3c4c-45b0-9142-bf5f3b33b40c admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.459167 Aug 31 12:52:57.794959 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 30/60] 10.222.0.58 () {64 vars in 1235 bytes} [Wed Aug 31 12:52:57 2022] POST /compute/v2.1/flavors => generated 409 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:52:58.786470 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-50585ab9-a901-4f07-81db-ace8cd96aa1a admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:52:58.787603 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-50585ab9-a901-4f07-81db-ace8cd96aa1a admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001577 Aug 31 12:52:58.788061 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 31/61] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Aug 31 12:52:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:52:59.344413 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-33598c83-2ad1-4cf3-b11d-32cd89ba07b0 admin admin] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:52:59.364827 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-33598c83-2ad1-4cf3-b11d-32cd89ba07b0 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.439883 Aug 31 12:52:59.365363 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 31/62] 10.222.0.58 () {60 vars in 1202 bytes} [Wed Aug 31 12:52:58 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:53:53.145579 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-50585ab9-a901-4f07-81db-ace8cd96aa1a admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:53:53.146628 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-50585ab9-a901-4f07-81db-ace8cd96aa1a admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 31 12:53:53.147001 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 32/63] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 31 12:53:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:53:53.157589 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG dbcounter [-] [105524] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:53.577999 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-2f61c41b-0818-4e32-8514-bef6a906cb07 admin admin] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:53:53.598521 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-2f61c41b-0818-4e32-8514-bef6a906cb07 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.445456 Aug 31 12:53:53.599051 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 32/64] 10.222.0.58 () {60 vars in 1292 bytes} [Wed Aug 31 12:53:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:53:53.620979 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG dbcounter [-] [105525] Writing DB stats nova_api:SELECT=14 {{(pid=105525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:53.624847 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-2dbbbbd6-a447-4c26-9b60-85f62cbf90aa admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:53:53.632700 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-2dbbbbd6-a447-4c26-9b60-85f62cbf90aa admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013250 Aug 31 12:53:53.633203 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 33/65] 10.222.0.58 () {60 vars in 1283 bytes} [Wed Aug 31 12:53:53 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:53:53.645138 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-4599f631-08ed-4d82-ba5d-ac4c874f9bc8 admin admin] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:53:53.652960 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-4599f631-08ed-4d82-ba5d-ac4c874f9bc8 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011452 Aug 31 12:53:53.653463 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 33/66] 10.222.0.58 () {60 vars in 1286 bytes} [Wed Aug 31 12:53:53 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:53:53.664973 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-df208fb7-bfbf-46c9-b4f2-61517b668fcb admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:53:53.672897 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-df208fb7-bfbf-46c9-b4f2-61517b668fcb admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011510 Aug 31 12:53:53.673496 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 34/67] 10.222.0.58 () {60 vars in 1286 bytes} [Wed Aug 31 12:53:53 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:53:53.685190 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-e99a67e8-7f48-45fc-824a-c71126af0dc6 admin admin] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:53:53.692843 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-e99a67e8-7f48-45fc-824a-c71126af0dc6 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011265 Aug 31 12:53:53.693347 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 34/68] 10.222.0.58 () {60 vars in 1283 bytes} [Wed Aug 31 12:53:53 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:57:00.884808 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-df208fb7-bfbf-46c9-b4f2-61517b668fcb admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:57:00.885811 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-df208fb7-bfbf-46c9-b4f2-61517b668fcb admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Aug 31 12:57:00.886189 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 35/69] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Aug 31 12:57:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:57:01.025483 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG dbcounter [-] [105524] Writing DB stats nova_api:SELECT=6 {{(pid=105524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:57:01.208078 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-45adaaeb-feb3-4aba-a6c6-8d7b4305f456 admin admin] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:57:01.213327 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-45adaaeb-feb3-4aba-a6c6-8d7b4305f456 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:01.213792 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-45adaaeb-feb3-4aba-a6c6-8d7b4305f456 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:01.214218 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-45adaaeb-feb3-4aba-a6c6-8d7b4305f456 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:01.214942 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-45adaaeb-feb3-4aba-a6c6-8d7b4305f456 admin admin] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:01.215380 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-45adaaeb-feb3-4aba-a6c6-8d7b4305f456 admin admin] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:01.215829 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-45adaaeb-feb3-4aba-a6c6-8d7b4305f456 admin admin] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:01.249456 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-45adaaeb-feb3-4aba-a6c6-8d7b4305f456 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.225570 Aug 31 12:57:01.250006 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 35/70] 10.222.0.58 () {60 vars in 1193 bytes} [Wed Aug 31 12:57:01 2022] GET /compute/v2.1/os-services => generated 791 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:57:02.072528 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-df208fb7-bfbf-46c9-b4f2-61517b668fcb admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:57:02.073531 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-df208fb7-bfbf-46c9-b4f2-61517b668fcb admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Aug 31 12:57:02.073927 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 36/71] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Aug 31 12:57:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:57:02.286410 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-41a8a47a-87f0-44f6-8707-37bb67b43394 admin admin] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:57:02.289817 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-41a8a47a-87f0-44f6-8707-37bb67b43394 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:02.290292 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-41a8a47a-87f0-44f6-8707-37bb67b43394 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:02.290710 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-41a8a47a-87f0-44f6-8707-37bb67b43394 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:02.291467 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-41a8a47a-87f0-44f6-8707-37bb67b43394 admin admin] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:02.291939 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-41a8a47a-87f0-44f6-8707-37bb67b43394 admin admin] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:02.292349 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-41a8a47a-87f0-44f6-8707-37bb67b43394 admin admin] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:02.312060 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-41a8a47a-87f0-44f6-8707-37bb67b43394 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.089052 Aug 31 12:57:02.312607 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 36/72] 10.222.0.58 () {60 vars in 1193 bytes} [Wed Aug 31 12:57:02 2022] GET /compute/v2.1/os-services => generated 791 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:57:13.683628 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-df208fb7-bfbf-46c9-b4f2-61517b668fcb admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:57:13.684668 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-df208fb7-bfbf-46c9-b4f2-61517b668fcb admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 31 12:57:13.685071 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 37/73] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Aug 31 12:57:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:57:13.832265 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG dbcounter [-] [105524] Writing DB stats nova_cell0:SELECT=4 {{(pid=105524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:57:13.833144 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG dbcounter [-] [105524] Writing DB stats nova_cell1:SELECT=4 {{(pid=105524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:57:13.833870 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG dbcounter [-] [105524] Writing DB stats nova_api:SELECT=8 {{(pid=105524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:57:13.889060 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-18324f7a-5a1a-438c-878c-35becc67c596 admin admin] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:57:13.892414 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-18324f7a-5a1a-438c-878c-35becc67c596 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:13.892886 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-18324f7a-5a1a-438c-878c-35becc67c596 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:13.893312 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-18324f7a-5a1a-438c-878c-35becc67c596 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:13.894019 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-18324f7a-5a1a-438c-878c-35becc67c596 admin admin] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:13.894455 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-18324f7a-5a1a-438c-878c-35becc67c596 admin admin] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:13.894871 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-18324f7a-5a1a-438c-878c-35becc67c596 admin admin] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:13.922125 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-18324f7a-5a1a-438c-878c-35becc67c596 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.096182 Aug 31 12:57:13.922959 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 37/74] 10.222.0.58 () {60 vars in 1193 bytes} [Wed Aug 31 12:57:13 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:57:14.755634 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-df208fb7-bfbf-46c9-b4f2-61517b668fcb admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:57:14.756647 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-df208fb7-bfbf-46c9-b4f2-61517b668fcb admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 31 12:57:14.757036 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 38/75] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Aug 31 12:57:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:57:14.957371 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-2fdf90e5-b316-46e8-8185-d3be3af87f07 admin admin] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:57:14.960679 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-2fdf90e5-b316-46e8-8185-d3be3af87f07 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:14.961152 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-2fdf90e5-b316-46e8-8185-d3be3af87f07 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:14.961576 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-2fdf90e5-b316-46e8-8185-d3be3af87f07 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:14.962286 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-2fdf90e5-b316-46e8-8185-d3be3af87f07 admin admin] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:14.962777 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-2fdf90e5-b316-46e8-8185-d3be3af87f07 admin admin] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:14.963193 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-2fdf90e5-b316-46e8-8185-d3be3af87f07 admin admin] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:14.985683 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-2fdf90e5-b316-46e8-8185-d3be3af87f07 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.089957 Aug 31 12:57:14.986607 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 38/76] 10.222.0.58 () {60 vars in 1193 bytes} [Wed Aug 31 12:57:14 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:58:14.256716 dv-cinder-854428-2-iscsi devstack@n-api.service[105523]: Wed Aug 31 12:58:14 2022 - graceful shutdown triggered... Aug 31 12:58:14.256807 dv-cinder-854428-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 31 12:58:14.257779 dv-cinder-854428-2-iscsi devstack@n-api.service[105524]: Gracefully killing worker 1 (pid: 105524)... Aug 31 12:58:14.258183 dv-cinder-854428-2-iscsi devstack@n-api.service[105525]: Gracefully killing worker 2 (pid: 105525)... Aug 31 12:58:15.259157 dv-cinder-854428-2-iscsi devstack@n-api.service[105523]: worker 1 buried after 1 seconds Aug 31 12:58:15.259157 dv-cinder-854428-2-iscsi devstack@n-api.service[105523]: worker 2 buried after 1 seconds Aug 31 12:58:15.259157 dv-cinder-854428-2-iscsi devstack@n-api.service[105523]: goodbye to uWSGI. Aug 31 12:58:15.261629 dv-cinder-854428-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 31 12:58:15.262526 dv-cinder-854428-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 31 12:58:15.266977 dv-cinder-854428-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 12:58:15.286878 dv-cinder-854428-2-iscsi devstack@n-api.service[120692]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 12:58:15.290106 dv-cinder-854428-2-iscsi devstack@n-api.service[120692]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 12:58:15 2022] *** Aug 31 12:58:15.290106 dv-cinder-854428-2-iscsi devstack@n-api.service[120692]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 12:58:15.290106 dv-cinder-854428-2-iscsi devstack@n-api.service[120692]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 12:58:15.290106 dv-cinder-854428-2-iscsi devstack@n-api.service[120692]: nodename: dv-cinder-854428-2-iscsi Aug 31 12:58:15.290106 dv-cinder-854428-2-iscsi devstack@n-api.service[120692]: machine: x86_64 Aug 31 12:58:15.290106 dv-cinder-854428-2-iscsi devstack@n-api.service[120692]: clock source: unix Aug 31 12:58:15.290106 dv-cinder-854428-2-iscsi devstack@n-api.service[120692]: pcre jit disabled Aug 31 12:58:15.290106 dv-cinder-854428-2-iscsi devstack@n-api.service[120692]: detected number of CPU cores: 4 Aug 31 12:58:15.290106 dv-cinder-854428-2-iscsi devstack@n-api.service[120692]: current working directory: / Aug 31 12:58:15.290106 dv-cinder-854428-2-iscsi devstack@n-api.service[120692]: detected binary path: /usr/bin/uwsgi-core Aug 31 12:58:15.290106 dv-cinder-854428-2-iscsi devstack@n-api.service[120692]: your processes number limit is 47680 Aug 31 12:58:15.291293 dv-cinder-854428-2-iscsi devstack@n-api.service[120692]: your memory page size is 4096 bytes Aug 31 12:58:15.291293 dv-cinder-854428-2-iscsi devstack@n-api.service[120692]: detected max file descriptor number: 2048 Aug 31 12:58:15.291293 dv-cinder-854428-2-iscsi devstack@n-api.service[120692]: lock engine: pthread robust mutexes Aug 31 12:58:15.291293 dv-cinder-854428-2-iscsi devstack@n-api.service[120692]: thunder lock: enabled Aug 31 12:58:15.291293 dv-cinder-854428-2-iscsi devstack@n-api.service[120692]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 12:58:15.291293 dv-cinder-854428-2-iscsi devstack@n-api.service[120692]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 12:58:15.330482 dv-cinder-854428-2-iscsi devstack@n-api.service[120692]: Python main interpreter initialized at 0x55a38cd8e9c0 Aug 31 12:58:15.330482 dv-cinder-854428-2-iscsi devstack@n-api.service[120692]: python threads support enabled Aug 31 12:58:15.330482 dv-cinder-854428-2-iscsi devstack@n-api.service[120692]: your server socket listen backlog is limited to 100 connections Aug 31 12:58:15.330482 dv-cinder-854428-2-iscsi devstack@n-api.service[120692]: your mercy for graceful operations on workers is 90 seconds Aug 31 12:58:15.330921 dv-cinder-854428-2-iscsi devstack@n-api.service[120692]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 12:58:15.330921 dv-cinder-854428-2-iscsi devstack@n-api.service[120692]: *** Operational MODE: preforking *** Aug 31 12:58:15.331189 dv-cinder-854428-2-iscsi devstack@n-api.service[120692]: *** uWSGI is running in multiple interpreter mode *** Aug 31 12:58:15.331189 dv-cinder-854428-2-iscsi devstack@n-api.service[120692]: spawned uWSGI master process (pid: 120692) Aug 31 12:58:15.331372 dv-cinder-854428-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 31 12:58:15.331960 dv-cinder-854428-2-iscsi devstack@n-api.service[120692]: spawned uWSGI worker 1 (pid: 120704, cores: 1) Aug 31 12:58:15.332476 dv-cinder-854428-2-iscsi devstack@n-api.service[120692]: spawned uWSGI worker 2 (pid: 120705, cores: 1) Aug 31 12:58:15.332745 dv-cinder-854428-2-iscsi devstack@n-api.service[120692]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 12:58:15.996482 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 12:58:15.997081 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 12:58:17.137036 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 12:58:17.137036 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: from cryptography.utils import int_from_bytes Aug 31 12:58:17.137798 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 12:58:17.137798 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: from cryptography.utils import int_from_bytes Aug 31 12:58:17.149834 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 12:58:17.149834 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: from cryptography.utils import int_from_bytes Aug 31 12:58:17.150382 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 12:58:17.150382 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: from cryptography.utils import int_from_bytes Aug 31 12:58:19.501466 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 12:58:19.502074 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 12:58:19.502331 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 12:58:19.502619 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 12:58:19.502858 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 12:58:19.503263 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.503586 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.503933 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.504250 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.504725 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.505061 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.505385 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.505678 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.506038 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.506277 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.506592 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.506913 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854428-2-iscsi {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.507242 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.507537 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.507873 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.508198 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.508501 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.508849 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.509133 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.509691 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.511165 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.511165 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.511165 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.511449 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.511690 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.512050 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.512366 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.512783 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.512987 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.513300 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.513771 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854428-2-iscsi {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.513999 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.514296 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.514641 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.515025 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.515355 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.515653 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.516019 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.516333 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.516646 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.516990 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.517336 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.517639 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.517956 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.518262 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.518561 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.518872 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.519178 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.519485 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.519790 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.520068 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.520376 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.520742 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.520996 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.521321 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.521571 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.521820 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.522136 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.522489 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.522794 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.523077 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.523398 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.523699 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.524036 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.524309 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.524769 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.524935 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.528890 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.529257 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.529617 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.529956 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.530319 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.530763 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.531027 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.531350 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.531707 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.532068 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.532388 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.532700 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.533034 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.533348 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.533661 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.533973 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.534304 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.534645 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.534980 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.535183 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.535497 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.535802 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.536144 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.536454 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.536762 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.537067 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.537355 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.537907 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.538082 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.538253 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.538556 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.538852 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.539157 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.539466 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.539770 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.540102 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.540427 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.540792 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.541103 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.541705 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.542011 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.542317 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.542636 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.542943 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.543257 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.543575 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.543909 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.544218 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.544536 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.544853 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.545161 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.545452 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.545751 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.546045 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.546304 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 12:58:19.546885 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.547044 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 12:58:19.547208 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.547208 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.547530 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 12:58:19.547678 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.547866 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 12:58:19.548019 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.548182 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 12:58:19.548328 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.548803 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.548971 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.549151 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.549333 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.549495 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.549650 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.549822 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.549978 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.549978 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.550291 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.550463 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.550618 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.550780 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.550942 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.551098 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.551252 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.551406 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.551563 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.551707 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.551881 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.552045 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.552200 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.552200 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854428-2-iscsi {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.552948 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.553094 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.553237 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.553408 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.553562 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.553890 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.554040 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.554187 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.554338 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.554501 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.554780 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.554938 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.555132 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.555296 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.555452 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.555452 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.555756 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.555952 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.556099 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.556312 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.556482 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.557160 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.557263 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.557349 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.557422 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.557499 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.557582 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.557666 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.557745 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.557823 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.557903 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.557903 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.558062 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.558155 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.558243 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.558329 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.558415 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.558507 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854428-2-iscsi {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.558587 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.558677 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.558767 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.558850 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.558944 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.559028 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.559109 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.559191 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.559279 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.559362 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.559452 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.559537 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.559630 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.559725 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.559832 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.560026 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.560127 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.560354 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.560446 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.560688 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.560774 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.560991 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.561072 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.561312 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.561394 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.561629 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.561709 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.561933 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.562014 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.562243 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.562332 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.562557 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.562649 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.562874 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.562970 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.563177 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.563263 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.563484 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.563571 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.563737 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.563840 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.564085 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.564173 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.564407 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.564565 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.564726 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.564813 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.565050 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.565141 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.565304 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.565403 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.565556 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.565669 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.565874 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.565966 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.566194 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.566286 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.566505 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.566584 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.566814 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.566901 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.567120 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.567209 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.567425 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.567505 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.567731 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.567838 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.568062 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.568143 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.568371 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.568449 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.568671 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.568757 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.568986 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.569075 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.569303 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.569383 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.569605 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.569684 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.570056 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.570150 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.570222 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.570289 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.570528 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.570624 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.570837 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.570928 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.571147 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.571234 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.571451 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.571544 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.571762 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.571889 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.572121 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.572211 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.572427 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.572516 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.572749 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.572853 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.573051 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.573139 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.573354 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.573442 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.573660 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.573748 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.573961 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.574048 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.574266 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.574347 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.574580 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.574668 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.574830 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.574917 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.575131 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.575220 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.575441 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.575536 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.575760 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.575862 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.576107 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.576202 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.576414 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.576494 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.576718 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.576797 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.577018 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.577107 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.577324 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.577408 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.577629 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.577708 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.577934 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.578025 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.578237 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.578331 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.578540 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.578620 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.578840 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.578929 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.579142 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.579221 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.579439 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.579526 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.579739 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.579874 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.580070 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.580160 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.580375 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.580462 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.581196 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.581313 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.581313 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.581445 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.581445 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.581589 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.581673 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.581744 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.581820 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.581899 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.582138 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.582234 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.582439 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.582537 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.582834 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.582954 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.583042 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.583125 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.583323 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.583424 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.583641 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.583740 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.583979 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.584083 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.584285 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.584384 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.584602 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.584694 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.584903 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.585001 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.585209 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.585301 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.585526 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.585619 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.585834 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.585926 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.586138 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.586231 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.586440 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.586540 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.586742 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.586836 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.587043 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.587133 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.587346 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.587435 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.587704 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.587797 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.588042 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.588193 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.588332 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.588474 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.588642 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.588789 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.588930 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.589076 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.589248 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.589400 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.589534 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.589666 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.589841 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.590057 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.590150 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:58:19.590276 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.590481 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.590649 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.590792 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.590945 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.591139 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.591340 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.591451 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.591787 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.591960 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.592141 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.592458 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.592550 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.592772 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.593131 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.593400 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.593575 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.593735 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.593735 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.594035 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.594178 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.594337 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.594481 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.594629 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.594836 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.595047 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.595218 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.595383 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.595536 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.595843 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.596066 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.596311 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.596553 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.596798 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.597022 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.597251 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.597498 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.597675 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.597834 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.597985 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.598130 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.598306 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.598306 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.598606 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.598761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.598916 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.599066 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.599066 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.599333 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.599489 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.599641 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.599784 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.599973 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.600124 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.600265 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.600431 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.600584 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.600733 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.600875 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.601016 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.601168 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.601323 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.601474 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.601634 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.601785 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.601927 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.602076 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.602270 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.602437 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.602591 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.602742 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.602891 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.603051 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.603314 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.603471 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.603613 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.603763 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.603931 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.604087 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.604239 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.604381 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.604541 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.604682 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.604825 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.604989 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.605140 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.605295 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.605450 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.605606 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.605763 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.605926 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.606075 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.606231 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.606389 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.606549 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.606697 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.606856 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.607013 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.607162 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.607317 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.607466 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.607623 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.607773 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.608082 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.608329 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.608582 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.608775 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.608949 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.609169 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.609398 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.609556 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.609720 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.609877 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.610038 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.610194 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.610351 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.610508 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.610664 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.610812 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.610969 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.611131 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.611285 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.611460 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.611620 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.611783 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.611955 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.612119 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.612323 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.612477 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.612625 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.612787 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.612947 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.613109 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.613259 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.613521 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.613676 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.613834 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.613992 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.614150 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.614302 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.614459 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.614609 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.614765 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.614914 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.615072 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.615249 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.615412 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.615571 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.615720 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.615933 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.616088 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.616244 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.616401 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.616559 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.616559 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.616859 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.617016 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.617172 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.617339 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.617502 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.617652 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.617800 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.617948 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.618104 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.618253 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.618412 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.618569 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.618779 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.618966 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.619119 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.619282 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.619438 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.619595 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.619752 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.620011 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.620165 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.620315 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.620463 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.620613 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.620769 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.620927 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.621076 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.621223 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.621382 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.621545 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.621707 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.621858 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.622776 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.622934 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.623134 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.623348 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.623546 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.623791 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.624000 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.624161 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.624331 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.624480 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.624630 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.624779 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.624935 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.625106 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.625266 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.625423 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.625572 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.625721 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.625998 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.626166 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.626325 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.626487 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.626636 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.626793 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.626941 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.627098 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.627255 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.627403 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.627552 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.627706 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.627956 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.628127 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.628278 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.628426 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.628585 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.628735 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.628898 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.629048 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.629203 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.629359 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.629518 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.629668 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.629825 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.629985 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.630142 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.630291 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.630459 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.630459 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.630756 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.630906 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.631055 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.631211 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.631368 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.631522 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.631687 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.631885 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.632042 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.632192 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.632339 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.632552 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.632706 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.632869 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.633025 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.633184 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.633339 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.633498 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.633657 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.633830 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.634089 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.634259 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.634445 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.634606 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.634767 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.634916 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.635073 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.635224 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.635417 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.635579 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.635736 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.635932 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.636101 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.636261 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.636426 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.636576 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.636732 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.636892 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.637042 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.637225 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.637387 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.637546 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.637697 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.637853 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.638016 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.638176 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.638176 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.638477 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.638632 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.638789 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.638949 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.639107 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.639258 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.639415 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.639563 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.639716 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.639716 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.640119 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.640273 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.640432 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.640540 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.640687 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.640779 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.640876 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.640968 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.641052 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.641145 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.641238 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.641330 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.641429 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.641518 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.641609 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.641694 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.641784 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.641878 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.641963 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.642055 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.642139 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.642222 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.642305 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.642403 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.642489 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.642636 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.642729 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.642828 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.642913 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.643009 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.643102 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.643187 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.643270 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.643270 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.643420 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.643554 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.643641 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.643730 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.643831 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.643929 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.644047 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.644182 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.644309 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.644309 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.644507 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.644601 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.644740 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.644829 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.644920 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.645012 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.645095 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.645185 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.645283 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.645375 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.645460 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.645541 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.645631 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.645716 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.645811 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.645896 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.645978 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.646067 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.646150 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.646241 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.646336 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.646420 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.646510 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.646593 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.646780 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.646882 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.647097 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.647189 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.647406 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.647506 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.647720 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.647866 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.648059 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.648217 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.648348 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.648445 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.648656 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.648826 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.648967 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.649061 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.649275 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.649376 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.649594 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.649701 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.649903 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.650043 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.650268 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.650360 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.650576 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.650674 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.650886 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.650976 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.651192 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.651281 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.651499 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.651781 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.651893 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.652131 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.652257 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.652442 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.652578 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.652756 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.652851 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.653068 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.653203 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.653380 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.653525 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.653691 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.653797 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.653998 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.654100 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.654309 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.654443 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.654617 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.654749 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.654952 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.655083 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.655218 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.655351 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.655505 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.655606 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.655847 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.655955 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.656149 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.656250 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.656456 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.656558 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.656768 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.656868 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.657075 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.657166 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.657379 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.657516 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.657685 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.657828 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.657991 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.658169 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.658341 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.658486 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.658615 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.658735 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.658886 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.659051 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.659372 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.659690 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.663876 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.664067 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.664174 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.664263 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.664361 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.664451 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.664537 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.664631 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.664717 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.664811 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.664811 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.664966 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.665054 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.665152 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.665315 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.665422 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.665525 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.665662 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.665764 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.665856 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.665942 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.666021 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.666119 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.666211 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.666614 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.666614 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.666614 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.666614 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.666614 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.666614 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.667219 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.667219 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.667418 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.667418 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.667591 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.667676 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.667759 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.667859 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.667944 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.668041 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.668134 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.668242 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.668324 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.668395 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.668465 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.668547 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.668626 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.668704 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.668791 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.668862 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.668945 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.669073 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.669221 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.669371 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.669504 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.669686 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.669817 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.669994 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.670139 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.670321 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.670536 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.670678 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.670827 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.670969 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.671120 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.671267 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.671444 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.671652 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.671799 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.672038 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.672137 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.672303 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.672403 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.672610 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.672702 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.672933 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.673022 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.673237 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.673349 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.673541 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.673636 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.673849 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.673948 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.674151 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.674254 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.674456 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.674589 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.674766 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.674859 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.675068 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.675206 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.675401 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.675532 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.675712 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.675834 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.676054 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.676157 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.676356 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.676453 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.676658 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.676750 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.676967 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.677067 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.677267 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.677366 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.677569 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.677668 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.677880 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.677982 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.678198 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.678290 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.678517 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.678618 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.678817 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.678925 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.679124 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.679279 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.679432 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.679534 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.679735 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.679845 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.680065 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.680155 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.680375 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.680465 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.680687 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.680780 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.680993 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.681084 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.681348 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.681468 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.681675 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.681768 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.681983 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.682075 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.682309 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.682399 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.682617 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.682717 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.682924 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.683025 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.683232 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.683334 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.683537 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.683637 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.683892 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.683998 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.684199 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.684305 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.684501 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.684601 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.684809 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.684901 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.685113 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.685291 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.685416 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.685506 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.685719 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.685821 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.686025 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.686130 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.686328 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.686420 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.686631 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.686733 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.686934 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.687027 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.687255 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.687355 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.687560 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.687667 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.687909 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.688016 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.688224 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.688325 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.688617 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.688766 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.688917 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.689059 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.689177 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.689270 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.689451 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.689586 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.689753 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.690085 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.690399 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.690573 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.690747 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.690923 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.691075 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.691232 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.691383 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.691534 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.691693 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.691918 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.692085 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.692247 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.692436 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.692600 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.692761 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.692913 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.693081 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.693240 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.693390 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.693554 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.693762 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.694079 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.694396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.694530 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.694706 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.694814 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.695023 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.695117 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.695852 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.695852 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.696097 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.696097 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.696259 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.696335 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.696408 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.696670 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.696774 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.696985 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.697088 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.697400 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.697506 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.697621 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.697869 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.697994 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.698186 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.698334 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.698473 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.698653 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.698872 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.699025 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.699166 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.699285 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.699390 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.699485 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.699581 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.699759 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.699908 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.700124 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.700230 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.700454 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.700557 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.700769 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.700869 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.701082 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.701175 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.701397 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.701491 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.701756 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.701890 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.702070 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.702179 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.702378 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.702470 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.702686 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.702779 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.702999 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.703098 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.703316 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.703418 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.703622 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.703703 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.703955 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.704066 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.704264 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.704363 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.704573 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.704664 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.704883 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.704982 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.705193 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.705291 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.705509 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.705612 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.705822 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.705916 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.706148 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.706251 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.706482 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.706610 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.706802 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.706906 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.707117 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.707211 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.707430 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.707523 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.707747 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.707874 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.708159 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.708326 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.708467 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.708644 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.708787 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.708979 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.709136 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.709323 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.709436 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.709628 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.709733 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.709952 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.710058 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.710279 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.710385 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.710608 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.710705 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.710915 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.711010 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.711220 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.711322 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.711532 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.711628 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.711858 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.711957 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.712165 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.712274 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.712509 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.712710 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.712846 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.713034 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.713134 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.713363 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.713465 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.713703 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.713943 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.714938 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.714938 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.715366 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.715692 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.715869 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.715965 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.716065 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.716195 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.716299 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.716396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.716396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.716560 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.716645 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.716738 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.716823 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.716823 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.716992 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.717078 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.717296 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.717482 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.717651 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.717809 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.717979 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.718223 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.718324 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.718541 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.718783 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.718883 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.719180 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.719354 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.719491 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.719799 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.719907 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.720419 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.720789 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.721117 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.721401 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.721647 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.721918 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.722427 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.722593 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.722701 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.722800 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.722895 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.722895 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.723050 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.723168 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.723606 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.723967 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.724087 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.724290 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.724429 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.724602 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.724795 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.724961 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.725137 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.725276 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.725560 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.725662 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.725954 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.726097 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.726214 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.726438 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.726793 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.726891 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.726993 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.727080 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.727163 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.727384 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.727488 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.727700 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.727829 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.728104 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.728202 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.728449 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.728544 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.728755 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.728861 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.729062 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.729157 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.729389 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.729510 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.729704 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.729816 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.730030 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.730135 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.730351 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.730446 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.730664 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.730759 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.731015 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.731110 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.731330 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.731424 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.731714 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.731926 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.732069 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.732267 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.732431 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.732593 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.732789 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.732963 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.733144 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.733253 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.733474 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.733666 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.733951 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.734124 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.734284 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.734436 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.734594 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.734755 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.734916 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.735079 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.735231 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.735389 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.735539 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.735698 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.735874 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.736100 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.736254 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.736412 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.736684 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.736855 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.737009 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.737181 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.737333 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.737483 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.737642 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.737795 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.737955 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.738113 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.738264 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.738420 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.738586 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.738744 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.738903 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.739054 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.739216 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.739404 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.739569 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.739729 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.739905 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.740075 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.740235 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.740477 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.740639 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.740791 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.740950 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.741102 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.741272 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.741434 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.741594 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.741752 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.741912 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.742063 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.742214 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.742376 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.742536 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.742690 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.742849 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.743007 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.743173 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.743339 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.743509 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.743669 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.743925 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.744082 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.744246 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.744406 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.744566 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.744792 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.744953 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.745104 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.745270 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.745440 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.745599 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.745751 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.745915 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.746080 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.746231 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.746389 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.746540 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.746723 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.746881 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.747048 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.747211 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.747373 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.747524 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.747682 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.747851 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.748021 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.748173 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.748334 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.748486 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.748636 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.748801 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.748955 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.749105 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.749281 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.749442 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.749594 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.749758 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.749915 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.750066 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.750223 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.750376 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.750527 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.750688 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.750838 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.750996 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.751157 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.751319 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.751479 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.751631 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.751789 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.752053 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.752053 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.752350 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.752513 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.752674 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.752824 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.752975 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.753133 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.753294 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.753461 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.753623 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.753777 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.753926 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.754076 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.754225 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.754388 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.754388 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.754672 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.754832 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.754992 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.755152 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.755324 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.755476 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.755626 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.755785 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.755957 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.756122 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.756274 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.756274 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.756559 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.756709 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.756859 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.757025 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.757175 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.757344 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.757502 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.757653 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.757804 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.757804 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.758099 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.758257 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.758417 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.758567 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.758731 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.758890 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.758890 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.759183 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.759394 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.759554 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.759714 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.759883 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.760039 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.760202 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.760353 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.760511 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.760674 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.760826 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.760975 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.761126 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.761287 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.761452 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.761603 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.761753 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.761912 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.762071 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.762233 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.762395 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.762547 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.762705 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.762856 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.763007 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.763166 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.763342 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.763503 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.763654 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.763804 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.764024 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.764177 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.764177 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.764691 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.765089 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.765267 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.765420 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.765694 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.765876 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.766029 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.766180 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.766359 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.766515 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.766692 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.766852 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.767003 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.767426 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.767605 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.767605 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.767943 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.768099 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.768262 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.768561 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.768889 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.769053 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.769205 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.769355 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.769553 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.769708 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.769859 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.770018 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.770199 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.770364 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.770528 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.770680 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.770839 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.771056 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.771199 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.771411 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.771550 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.771674 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 12:58:19.772147 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.772518 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.772945 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.773265 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.773728 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.774099 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.774492 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.775249 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.775579 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.776048 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.776443 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.777028 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.777914 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.778259 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.778612 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.778955 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.779273 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.779588 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.780124 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.780465 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.780787 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.781109 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.781431 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.781752 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.782069 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.782385 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.783063 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.783369 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.783690 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.784036 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.784354 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.784700 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.785360 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.785699 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.787233 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.787233 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.787233 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.787598 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.787751 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.788098 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.788415 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.788731 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.789047 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.789359 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.789679 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.790049 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.790369 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.790735 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.791210 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.791873 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.792202 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.792527 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.792841 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.793166 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.793492 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.793809 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.794134 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.794447 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.795375 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.796092 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.796437 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.796773 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.797088 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.797404 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.797842 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.798154 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.798485 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.799031 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.799349 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.799660 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.800002 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.800317 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.800631 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.800943 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.801281 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.801617 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.801912 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.802221 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.802532 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.802964 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.803279 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.803589 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.803928 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.804240 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.804550 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.804870 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.805380 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.805688 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.806027 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.806393 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.807064 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.807400 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.807788 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.808147 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.808418 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.808745 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.809074 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.809399 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.810059 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.810402 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.811046 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.811371 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.811693 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.812057 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.812377 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.812695 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.813027 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.813355 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.813667 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.813999 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.814319 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.814644 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.814969 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.815829 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.816184 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.816821 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.817150 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.817466 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.817787 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.818103 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.818425 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.818746 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.819065 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.819388 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.819708 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.820065 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.820439 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.821124 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.821390 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.821722 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.822128 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.822445 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.822793 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.823126 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.823447 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.823762 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.824097 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:58:19.824343 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 12:58:19.835436 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO dbcounter [None req-69fce85a-852c-44f9-945e-ad65724163e4 None None] Registered counter for database nova_api Aug 31 12:58:19.856196 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_db.sqlalchemy.engines [None req-69fce85a-852c-44f9-945e-ad65724163e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120705) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:58:19.863036 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writer thread running {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:58:19.892351 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO dbcounter [None req-01402002-fe84-4c3a-9164-e48c02c54d26 None None] Registered counter for database nova_api Aug 31 12:58:19.915527 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_db.sqlalchemy.engines [None req-01402002-fe84-4c3a-9164-e48c02c54d26 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120704) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:58:19.920040 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.context [None req-69fce85a-852c-44f9-945e-ad65724163e4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a934bcd7-fa17-435e-9285-cae87d73e85f(cell1) {{(pid=120705) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 12:58:19.924139 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-69fce85a-852c-44f9-945e-ad65724163e4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:19.924636 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-69fce85a-852c-44f9-945e-ad65724163e4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:19.926529 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-69fce85a-852c-44f9-945e-ad65724163e4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:19.927271 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-69fce85a-852c-44f9-945e-ad65724163e4 None None] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:19.927730 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-69fce85a-852c-44f9-945e-ad65724163e4 None None] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:19.929775 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-69fce85a-852c-44f9-945e-ad65724163e4 None None] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:19.930342 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writer thread running {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:58:19.931859 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO dbcounter [None req-69fce85a-852c-44f9-945e-ad65724163e4 None None] Registered counter for database nova_cell0 Aug 31 12:58:19.937984 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO dbcounter [None req-69fce85a-852c-44f9-945e-ad65724163e4 None None] Registered counter for database nova_cell1 Aug 31 12:58:19.945154 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_db.sqlalchemy.engines [None req-69fce85a-852c-44f9-945e-ad65724163e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120705) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:58:19.950842 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writer thread running {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:58:19.951530 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_db.sqlalchemy.engines [None req-69fce85a-852c-44f9-945e-ad65724163e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120705) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:58:19.993103 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.context [None req-01402002-fe84-4c3a-9164-e48c02c54d26 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a934bcd7-fa17-435e-9285-cae87d73e85f(cell1) {{(pid=120704) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 12:58:19.997237 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-01402002-fe84-4c3a-9164-e48c02c54d26 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:19.997723 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-01402002-fe84-4c3a-9164-e48c02c54d26 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:19.999280 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-01402002-fe84-4c3a-9164-e48c02c54d26 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:20.000045 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-01402002-fe84-4c3a-9164-e48c02c54d26 None None] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:20.000483 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-01402002-fe84-4c3a-9164-e48c02c54d26 None None] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:20.002481 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-01402002-fe84-4c3a-9164-e48c02c54d26 None None] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:20.004525 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO dbcounter [None req-01402002-fe84-4c3a-9164-e48c02c54d26 None None] Registered counter for database nova_cell0 Aug 31 12:58:20.008612 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO dbcounter [None req-01402002-fe84-4c3a-9164-e48c02c54d26 None None] Registered counter for database nova_cell1 Aug 31 12:58:20.017323 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_db.sqlalchemy.engines [None req-01402002-fe84-4c3a-9164-e48c02c54d26 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120704) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:58:20.018515 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_db.sqlalchemy.engines [None req-01402002-fe84-4c3a-9164-e48c02c54d26 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120704) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:58:20.025258 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writer thread running {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:58:20.026540 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writer thread running {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:58:20.095764 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writer thread running {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:58:20.105166 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO dbcounter [None req-69fce85a-852c-44f9-945e-ad65724163e4 None None] Registered counter for database nova_cell0 Aug 31 12:58:20.112206 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_db.sqlalchemy.engines [None req-69fce85a-852c-44f9-945e-ad65724163e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120705) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:58:20.116963 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writer thread running {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:58:20.171638 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO dbcounter [None req-01402002-fe84-4c3a-9164-e48c02c54d26 None None] Registered counter for database nova_cell0 Aug 31 12:58:20.178976 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_db.sqlalchemy.engines [None req-01402002-fe84-4c3a-9164-e48c02c54d26 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120704) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:58:20.183499 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writer thread running {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:58:20.438197 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: WARNING keystonemiddleware.auth_token [None req-69fce85a-852c-44f9-945e-ad65724163e4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 12:58:20.445785 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: WARNING keystonemiddleware.auth_token [None req-69fce85a-852c-44f9-945e-ad65724163e4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 12:58:20.498688 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: WARNING keystonemiddleware.auth_token [None req-01402002-fe84-4c3a-9164-e48c02c54d26 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 12:58:20.506060 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: WARNING keystonemiddleware.auth_token [None req-01402002-fe84-4c3a-9164-e48c02c54d26 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 12:58:20.801557 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: WARNING keystonemiddleware.auth_token [None req-69fce85a-852c-44f9-945e-ad65724163e4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 12:58:20.807636 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: WARNING keystonemiddleware.auth_token [None req-69fce85a-852c-44f9-945e-ad65724163e4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 12:58:20.813024 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a38cd8e9c0 pid: 120705 (default app) Aug 31 12:58:20.856307 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: WARNING keystonemiddleware.auth_token [None req-01402002-fe84-4c3a-9164-e48c02c54d26 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 12:58:20.862351 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: WARNING keystonemiddleware.auth_token [None req-01402002-fe84-4c3a-9164-e48c02c54d26 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 12:58:20.867690 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a38cd8e9c0 pid: 120704 (default app) Aug 31 12:58:57.629757 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=3 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:58:57.631602 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=3 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:58:57.635868 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=3 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:58:57.636889 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=3 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:58:57.913730 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_api:SELECT=3 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:58:57.914547 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell0:SELECT=3 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:58:57.915352 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell1:SELECT=3 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:58:57.922445 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell0:SELECT=3 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:58:59.413487 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-a0c7a958-b81d-44a8-8776-06f23ef85173 tempest-VolumesNegativeTest-1400280582 tempest-VolumesNegativeTest-1400280582-project] Action: 'create', calling method: .version_select at 0x7f1952365e50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1591793893", "metadata": {"Type": "work"}}} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:58:59.440304 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-a0c7a958-b81d-44a8-8776-06f23ef85173 tempest-VolumesNegativeTest-1400280582 tempest-VolumesNegativeTest-1400280582-project] Request method failure captured: Aug 31 12:58:59.440304 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 12:58:59.440304 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept: application/json Aug 31 12:58:59.440304 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept-Encoding: identity Aug 31 12:58:59.440304 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Connection: close Aug 31 12:58:59.440304 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Length: 122 Aug 31 12:58:59.440304 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Type: application/json Aug 31 12:58:59.440304 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Host: 10.222.0.58 Aug 31 12:58:59.440304 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Openstack-System-Scope: None Aug 31 12:58:59.440304 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: User-Agent: python-urllib3/1.26.12 Aug 31 12:58:59.440304 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Auth-Token: gAAAAABjD1sRT373NXh70i5lncaR3HY8hPN9P5l5HNv6cmZMVDqT2CNcKfA_o9dv7tMu3pR28GGYBM9Vw5z97zvT_QMe2YOTtKZ9gn94OGKcYclLKFOYGycYCmDdbO5tDmmbyrhY9RquOWKL05Ro1yTg50_ezSa0Wj2gJzHobMEimxov2OUd6WU Aug 31 12:58:59.440304 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Id: None Aug 31 12:58:59.440304 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Name: None Aug 31 12:58:59.440304 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Identity-Status: Confirmed Aug 31 12:58:59.440304 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Is-Admin-Project: True Aug 31 12:58:59.440304 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Id: default Aug 31 12:58:59.440304 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Name: Default Aug 31 12:58:59.440304 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Id: 559f436e87f44f5d825bba3fa18f9def Aug 31 12:58:59.440304 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Name: tempest-VolumesNegativeTest-1400280582 Aug 31 12:58:59.440304 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Role: member,reader Aug 31 12:58:59.440304 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Roles: member,reader Aug 31 12:58:59.442078 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_559f436e87f44f5d825bba3fa18f9def"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/559f436e87f44f5d825bba3fa18f9def"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/559f436e87f44f5d825bba3fa18f9def"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/559f436e87f44f5d825bba3fa18f9def"}]}] Aug 31 12:58:59.442078 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant: tempest-VolumesNegativeTest-1400280582 Aug 31 12:58:59.442078 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Id: 559f436e87f44f5d825bba3fa18f9def Aug 31 12:58:59.442078 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Name: tempest-VolumesNegativeTest-1400280582 Aug 31 12:58:59.442078 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User: tempest-VolumesNegativeTest-1400280582-project Aug 31 12:58:59.442078 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Id: default Aug 31 12:58:59.442078 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Name: Default Aug 31 12:58:59.442078 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Id: a836d570eeb341ee966b895a2f11c721 Aug 31 12:58:59.442078 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Name: tempest-VolumesNegativeTest-1400280582-project Aug 31 12:58:59.442078 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Aug 31 12:58:59.442078 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1591793893", "metadata": {"Type": "work"}}} Aug 31 12:58:59.442078 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: method: Aug 31 12:58:59.442078 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 12:58:59.442915 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1591793893', 'metadata': {'Type': 'work'}}}} Aug 31 12:58:59.442915 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:58:59.442915 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:58:59.442915 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 12:58:59.442915 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 12:58:59.442915 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 12:58:59.442915 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise error Aug 31 12:58:59.442915 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 31 12:58:59.442915 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.442915 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 31 12:58:59.442915 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 12:58:59.442915 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.442915 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 12:58:59.442915 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi '#$%' Aug 31 12:58:59.442915 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.442915 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:58:59.442915 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.442915 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:58:59.442915 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:58:59.442915 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:58:59.442915 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:58:59.442915 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:58:59.444274 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 12:58:59.444274 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 12:58:59.444274 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:58:59.444274 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:58:59.444274 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 12:58:59.444274 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 12:58:59.444274 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 12:58:59.444274 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 12:58:59.444274 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 12:58:59.444274 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 12:58:59.444274 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 12:58:59.444274 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.444274 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:58:59.444274 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.444274 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:58:59.444274 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:58:59.444274 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:58:59.444274 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 12:58:59.444274 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 12:58:59.448269 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 12:58:59.448269 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.448269 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-a0c7a958-b81d-44a8-8776-06f23ef85173 tempest-VolumesNegativeTest-1400280582 tempest-VolumesNegativeTest-1400280582-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:58:59.448269 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-a0c7a958-b81d-44a8-8776-06f23ef85173 tempest-VolumesNegativeTest-1400280582 tempest-VolumesNegativeTest-1400280582-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.535249 Aug 31 12:58:59.448538 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3e6e10e8-9f59-45f9-967e-7d539030ed7a tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] Action: 'create', calling method: .version_select at 0x7f1952364e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1106115920"}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:58:59.451345 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 1/1] 10.222.0.58 () {60 vars in 1156 bytes} [Wed Aug 31 12:58:57 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1544 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 31 12:58:59.456704 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-f6207fed-6ab2-4738-8337-3168b47688fd tempest-VolumesNegativeTest-1400280582 tempest-VolumesNegativeTest-1400280582-project] Action: 'create', calling method: .version_select at 0x7f1952335940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1349601249", "metadata": {"Type": "work"}}} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:58:59.472201 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-f6207fed-6ab2-4738-8337-3168b47688fd tempest-VolumesNegativeTest-1400280582 tempest-VolumesNegativeTest-1400280582-project] Request method failure captured: Aug 31 12:58:59.472201 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 12:58:59.472201 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept: application/json Aug 31 12:58:59.472201 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept-Encoding: identity Aug 31 12:58:59.472201 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Connection: close Aug 31 12:58:59.472201 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Length: 120 Aug 31 12:58:59.472201 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Type: application/json Aug 31 12:58:59.472201 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Host: 10.222.0.58 Aug 31 12:58:59.472201 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Openstack-System-Scope: None Aug 31 12:58:59.472201 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: User-Agent: python-urllib3/1.26.12 Aug 31 12:58:59.472201 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Auth-Token: gAAAAABjD1sRT373NXh70i5lncaR3HY8hPN9P5l5HNv6cmZMVDqT2CNcKfA_o9dv7tMu3pR28GGYBM9Vw5z97zvT_QMe2YOTtKZ9gn94OGKcYclLKFOYGycYCmDdbO5tDmmbyrhY9RquOWKL05Ro1yTg50_ezSa0Wj2gJzHobMEimxov2OUd6WU Aug 31 12:58:59.472201 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Id: None Aug 31 12:58:59.472201 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Name: None Aug 31 12:58:59.472201 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Identity-Status: Confirmed Aug 31 12:58:59.472201 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Is-Admin-Project: True Aug 31 12:58:59.472201 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Id: default Aug 31 12:58:59.472201 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Name: Default Aug 31 12:58:59.472201 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Id: 559f436e87f44f5d825bba3fa18f9def Aug 31 12:58:59.472201 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Name: tempest-VolumesNegativeTest-1400280582 Aug 31 12:58:59.472201 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Role: member,reader Aug 31 12:58:59.472201 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Roles: member,reader Aug 31 12:58:59.473849 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_559f436e87f44f5d825bba3fa18f9def"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/559f436e87f44f5d825bba3fa18f9def"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/559f436e87f44f5d825bba3fa18f9def"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/559f436e87f44f5d825bba3fa18f9def"}]}] Aug 31 12:58:59.473849 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant: tempest-VolumesNegativeTest-1400280582 Aug 31 12:58:59.473849 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Id: 559f436e87f44f5d825bba3fa18f9def Aug 31 12:58:59.473849 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Name: tempest-VolumesNegativeTest-1400280582 Aug 31 12:58:59.473849 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User: tempest-VolumesNegativeTest-1400280582-project Aug 31 12:58:59.473849 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Id: default Aug 31 12:58:59.473849 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Name: Default Aug 31 12:58:59.473849 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Id: a836d570eeb341ee966b895a2f11c721 Aug 31 12:58:59.473849 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Name: tempest-VolumesNegativeTest-1400280582-project Aug 31 12:58:59.473849 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Aug 31 12:58:59.473849 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1349601249", "metadata": {"Type": "work"}}} Aug 31 12:58:59.473849 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: method: Aug 31 12:58:59.473849 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 12:58:59.474759 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1349601249', 'metadata': {'Type': 'work'}}}} Aug 31 12:58:59.474759 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:58:59.474759 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:58:59.474759 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 12:58:59.474759 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 12:58:59.474759 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 12:58:59.474759 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise error Aug 31 12:58:59.474759 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 31 12:58:59.474759 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.474759 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 31 12:58:59.474759 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 12:58:59.474759 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.474759 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 12:58:59.474759 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi '0' Aug 31 12:58:59.474759 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.474759 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:58:59.474759 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.474759 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:58:59.474759 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:58:59.474759 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:58:59.474759 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:58:59.474759 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:58:59.483014 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 12:58:59.483014 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 12:58:59.483014 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:58:59.483014 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:58:59.483014 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 12:58:59.483014 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 12:58:59.483014 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 12:58:59.483014 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 12:58:59.483014 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 12:58:59.483014 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 12:58:59.483014 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 12:58:59.483014 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.483014 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:58:59.483014 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.483014 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:58:59.483014 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:58:59.483014 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:58:59.483014 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 12:58:59.483014 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 12:58:59.484628 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 12:58:59.484628 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.484628 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-f6207fed-6ab2-4738-8337-3168b47688fd tempest-VolumesNegativeTest-1400280582 tempest-VolumesNegativeTest-1400280582-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:58:59.484628 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-f6207fed-6ab2-4738-8337-3168b47688fd tempest-VolumesNegativeTest-1400280582 tempest-VolumesNegativeTest-1400280582-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.022924 Aug 31 12:58:59.484628 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 2/2] 10.222.0.58 () {60 vars in 1156 bytes} [Wed Aug 31 12:58:59 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 12:58:59.492975 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-9f8baa93-11d5-4f49-8d09-d442f93c58ea tempest-VolumesNegativeTest-1400280582 tempest-VolumesNegativeTest-1400280582-project] Action: 'create', calling method: .version_select at 0x7f195220f9d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2029484422", "metadata": {"Type": "work"}}} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:58:59.513761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-9f8baa93-11d5-4f49-8d09-d442f93c58ea tempest-VolumesNegativeTest-1400280582 tempest-VolumesNegativeTest-1400280582-project] Request method failure captured: Aug 31 12:58:59.513761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 12:58:59.513761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept: application/json Aug 31 12:58:59.513761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept-Encoding: identity Aug 31 12:58:59.513761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Connection: close Aug 31 12:58:59.513761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Length: 119 Aug 31 12:58:59.513761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Type: application/json Aug 31 12:58:59.513761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Host: 10.222.0.58 Aug 31 12:58:59.513761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Openstack-System-Scope: None Aug 31 12:58:59.513761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: User-Agent: python-urllib3/1.26.12 Aug 31 12:58:59.513761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Auth-Token: gAAAAABjD1sRT373NXh70i5lncaR3HY8hPN9P5l5HNv6cmZMVDqT2CNcKfA_o9dv7tMu3pR28GGYBM9Vw5z97zvT_QMe2YOTtKZ9gn94OGKcYclLKFOYGycYCmDdbO5tDmmbyrhY9RquOWKL05Ro1yTg50_ezSa0Wj2gJzHobMEimxov2OUd6WU Aug 31 12:58:59.513761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Id: None Aug 31 12:58:59.513761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Name: None Aug 31 12:58:59.513761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Identity-Status: Confirmed Aug 31 12:58:59.513761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Is-Admin-Project: True Aug 31 12:58:59.513761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Id: default Aug 31 12:58:59.513761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Name: Default Aug 31 12:58:59.513761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Id: 559f436e87f44f5d825bba3fa18f9def Aug 31 12:58:59.513761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Name: tempest-VolumesNegativeTest-1400280582 Aug 31 12:58:59.513761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Role: member,reader Aug 31 12:58:59.513761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Roles: member,reader Aug 31 12:58:59.515037 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_559f436e87f44f5d825bba3fa18f9def"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/559f436e87f44f5d825bba3fa18f9def"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/559f436e87f44f5d825bba3fa18f9def"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/559f436e87f44f5d825bba3fa18f9def"}]}] Aug 31 12:58:59.515037 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant: tempest-VolumesNegativeTest-1400280582 Aug 31 12:58:59.515037 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Id: 559f436e87f44f5d825bba3fa18f9def Aug 31 12:58:59.515037 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Name: tempest-VolumesNegativeTest-1400280582 Aug 31 12:58:59.515037 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User: tempest-VolumesNegativeTest-1400280582-project Aug 31 12:58:59.515037 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Id: default Aug 31 12:58:59.515037 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Name: Default Aug 31 12:58:59.515037 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Id: a836d570eeb341ee966b895a2f11c721 Aug 31 12:58:59.515037 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Name: tempest-VolumesNegativeTest-1400280582-project Aug 31 12:58:59.515037 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Aug 31 12:58:59.515037 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2029484422", "metadata": {"Type": "work"}}} Aug 31 12:58:59.515037 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: method: Aug 31 12:58:59.515037 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 12:58:59.515851 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2029484422', 'metadata': {'Type': 'work'}}}} Aug 31 12:58:59.515851 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:58:59.515851 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:58:59.515851 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 12:58:59.515851 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 12:58:59.515851 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 12:58:59.515851 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise error Aug 31 12:58:59.515851 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 31 12:58:59.515851 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.515851 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 31 12:58:59.515851 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 12:58:59.515851 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.515851 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 12:58:59.515851 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi '' Aug 31 12:58:59.515851 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.515851 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:58:59.515851 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.515851 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:58:59.515851 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:58:59.515851 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:58:59.515851 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:58:59.515851 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:58:59.519722 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 12:58:59.519722 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 12:58:59.519722 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:58:59.519722 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:58:59.519722 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 12:58:59.519722 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 12:58:59.519722 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 12:58:59.519722 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 12:58:59.519722 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 12:58:59.519722 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 12:58:59.519722 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 12:58:59.519722 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.519722 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:58:59.519722 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.519722 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:58:59.519722 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:58:59.519722 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:58:59.519722 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 12:58:59.519722 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 12:58:59.520815 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 12:58:59.520815 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.520815 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-9f8baa93-11d5-4f49-8d09-d442f93c58ea tempest-VolumesNegativeTest-1400280582 tempest-VolumesNegativeTest-1400280582-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:58:59.520815 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-9f8baa93-11d5-4f49-8d09-d442f93c58ea tempest-VolumesNegativeTest-1400280582 tempest-VolumesNegativeTest-1400280582-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.030004 Aug 31 12:58:59.520815 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 3/3] 10.222.0.58 () {60 vars in 1156 bytes} [Wed Aug 31 12:58:59 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 31 12:58:59.535130 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-906eba9c-8904-4190-836b-68eabced6ec1 tempest-VolumesNegativeTest-1400280582 tempest-VolumesNegativeTest-1400280582-project] Calling method '.version_select at 0x7f195220f700>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:00.395382 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.wsgi [None req-906eba9c-8904-4190-836b-68eabced6ec1 tempest-VolumesNegativeTest-1400280582 tempest-VolumesNegativeTest-1400280582-project] HTTP exception thrown: Volume tempest-invalid-990993875 could not be found. Aug 31 12:59:00.400827 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-906eba9c-8904-4190-836b-68eabced6ec1 tempest-VolumesNegativeTest-1400280582 tempest-VolumesNegativeTest-1400280582-project] Request method failure captured: Aug 31 12:59:00.400827 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-990993875 HTTP/1.1 Aug 31 12:59:00.400827 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept: application/json Aug 31 12:59:00.400827 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept-Encoding: identity Aug 31 12:59:00.400827 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Connection: close Aug 31 12:59:00.400827 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Length: 0 Aug 31 12:59:00.400827 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Type: application/json Aug 31 12:59:00.400827 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Host: 10.222.0.58 Aug 31 12:59:00.400827 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Openstack-System-Scope: None Aug 31 12:59:00.400827 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: User-Agent: python-urllib3/1.26.12 Aug 31 12:59:00.400827 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Auth-Token: gAAAAABjD1sRT373NXh70i5lncaR3HY8hPN9P5l5HNv6cmZMVDqT2CNcKfA_o9dv7tMu3pR28GGYBM9Vw5z97zvT_QMe2YOTtKZ9gn94OGKcYclLKFOYGycYCmDdbO5tDmmbyrhY9RquOWKL05Ro1yTg50_ezSa0Wj2gJzHobMEimxov2OUd6WU Aug 31 12:59:00.400827 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Id: None Aug 31 12:59:00.400827 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Name: None Aug 31 12:59:00.400827 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Identity-Status: Confirmed Aug 31 12:59:00.400827 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Is-Admin-Project: True Aug 31 12:59:00.400827 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Id: default Aug 31 12:59:00.400827 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Name: Default Aug 31 12:59:00.400827 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Id: 559f436e87f44f5d825bba3fa18f9def Aug 31 12:59:00.400827 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Name: tempest-VolumesNegativeTest-1400280582 Aug 31 12:59:00.400827 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Role: member,reader Aug 31 12:59:00.400827 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Roles: member,reader Aug 31 12:59:00.402411 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_559f436e87f44f5d825bba3fa18f9def"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/559f436e87f44f5d825bba3fa18f9def"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/559f436e87f44f5d825bba3fa18f9def"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/559f436e87f44f5d825bba3fa18f9def"}]}] Aug 31 12:59:00.402411 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant: tempest-VolumesNegativeTest-1400280582 Aug 31 12:59:00.402411 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Id: 559f436e87f44f5d825bba3fa18f9def Aug 31 12:59:00.402411 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Name: tempest-VolumesNegativeTest-1400280582 Aug 31 12:59:00.402411 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User: tempest-VolumesNegativeTest-1400280582-project Aug 31 12:59:00.402411 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Id: default Aug 31 12:59:00.402411 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Name: Default Aug 31 12:59:00.402411 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Id: a836d570eeb341ee966b895a2f11c721 Aug 31 12:59:00.402411 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Name: tempest-VolumesNegativeTest-1400280582-project Aug 31 12:59:00.402411 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: method: Aug 31 12:59:00.402411 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: exception: Volume tempest-invalid-990993875 could not be found. Aug 31 12:59:00.402411 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: action_args: {'id': 'tempest-invalid-990993875'} Aug 31 12:59:00.402411 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:59:00.403354 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:59:00.403354 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 12:59:00.403354 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 12:59:00.403354 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 12:59:00.403354 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 12:59:00.403354 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 12:59:00.403354 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 12:59:00.403354 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 12:59:00.403354 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 12:59:00.403354 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 12:59:00.403354 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 12:59:00.403354 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:59:00.403354 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:59:00.403354 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:59:00.403354 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:59:00.403354 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-990993875 could not be found. (HTTP 404) (Request-ID: req-4bc95641-fbe7-48ca-8965-2ffd52632d33) Aug 31 12:59:00.403354 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:59:00.403354 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:59:00.403354 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:59:00.409208 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:59:00.409208 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 12:59:00.409208 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 12:59:00.409208 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 12:59:00.409208 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 12:59:00.409208 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 12:59:00.409208 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 12:59:00.409208 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 12:59:00.409208 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 12:59:00.409208 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 12:59:00.409208 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 12:59:00.409208 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 12:59:00.409208 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 12:59:00.409208 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 12:59:00.409208 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 12:59:00.409208 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 12:59:00.409208 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 12:59:00.409208 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 12:59:00.409208 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 12:59:00.410674 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:59:00.410674 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:59:00.410674 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:59:00.410674 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:59:00.410674 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-990993875 could not be found. Aug 31 12:59:00.410674 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:59:00.410674 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:59:00.410674 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:59:00.410674 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:59:00.410674 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:59:00.410674 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:59:00.410674 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:59:00.410674 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:59:00.410674 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 12:59:00.410674 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 12:59:00.410674 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:59:00.410674 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:59:00.410674 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 12:59:00.410674 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:59:00.410674 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-990993875 could not be found. Aug 31 12:59:00.411838 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:59:00.411838 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:59:00.411838 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:59:00.411838 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:59:00.411838 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:59:00.411838 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:59:00.411838 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:59:00.411838 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:59:00.411838 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-990993875 could not be found. Aug 31 12:59:00.411838 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:59:00.411838 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-906eba9c-8904-4190-836b-68eabced6ec1 tempest-VolumesNegativeTest-1400280582 tempest-VolumesNegativeTest-1400280582-project] Returning 404 to user: Volume tempest-invalid-990993875 could not be found. {{(pid=120704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:59:00.411838 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-906eba9c-8904-4190-836b-68eabced6ec1 tempest-VolumesNegativeTest-1400280582 tempest-VolumesNegativeTest-1400280582-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/tempest-invalid-990993875" status: 404 len: 98 microversion: 2.1 time: 0.874199 Aug 31 12:59:00.411838 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 4/4] 10.222.0.58 () {58 vars in 1215 bytes} [Wed Aug 31 12:58:59 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-990993875 => generated 98 bytes in 875 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 12:59:00.415282 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-d426d456-4eac-458d-81fc-5cc9b1ec8ff8 tempest-VolumesNegativeTest-1400280582 tempest-VolumesNegativeTest-1400280582-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004015 Aug 31 12:59:00.416183 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 5/5] 10.222.0.58 () {58 vars in 1140 bytes} [Wed Aug 31 12:59:00 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 31 12:59:00.432817 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-49bc0247-26df-45fb-a5f0-412ec7f49215 tempest-VolumesNegativeTest-1400280582 tempest-VolumesNegativeTest-1400280582-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003816 Aug 31 12:59:00.433335 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 6/6] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 31 12:59:00 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 31 12:59:00.442937 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-4012a002-51ba-4a6c-b90f-10e4bc6bb9f5 tempest-VolumesNegativeTest-1400280582 tempest-VolumesNegativeTest-1400280582-project] Calling method '.version_select at 0x7f1952174d30>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:00.590614 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.wsgi [None req-4012a002-51ba-4a6c-b90f-10e4bc6bb9f5 tempest-VolumesNegativeTest-1400280582 tempest-VolumesNegativeTest-1400280582-project] HTTP exception thrown: Volume 9a03a1c9-5fa4-4b8d-a81f-db62861b097e could not be found. Aug 31 12:59:00.594677 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-4012a002-51ba-4a6c-b90f-10e4bc6bb9f5 tempest-VolumesNegativeTest-1400280582 tempest-VolumesNegativeTest-1400280582-project] Request method failure captured: Aug 31 12:59:00.594677 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: request: DELETE /compute/v2.1/os-volumes/9a03a1c9-5fa4-4b8d-a81f-db62861b097e HTTP/1.1 Aug 31 12:59:00.594677 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept: application/json Aug 31 12:59:00.594677 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept-Encoding: identity Aug 31 12:59:00.594677 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Connection: close Aug 31 12:59:00.594677 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Length: 0 Aug 31 12:59:00.594677 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Type: application/json Aug 31 12:59:00.594677 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Host: 10.222.0.58 Aug 31 12:59:00.594677 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Openstack-System-Scope: None Aug 31 12:59:00.594677 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: User-Agent: python-urllib3/1.26.12 Aug 31 12:59:00.594677 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Auth-Token: gAAAAABjD1sRT373NXh70i5lncaR3HY8hPN9P5l5HNv6cmZMVDqT2CNcKfA_o9dv7tMu3pR28GGYBM9Vw5z97zvT_QMe2YOTtKZ9gn94OGKcYclLKFOYGycYCmDdbO5tDmmbyrhY9RquOWKL05Ro1yTg50_ezSa0Wj2gJzHobMEimxov2OUd6WU Aug 31 12:59:00.594677 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Id: None Aug 31 12:59:00.594677 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Name: None Aug 31 12:59:00.594677 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Identity-Status: Confirmed Aug 31 12:59:00.594677 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Is-Admin-Project: True Aug 31 12:59:00.594677 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Id: default Aug 31 12:59:00.594677 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Name: Default Aug 31 12:59:00.594677 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Id: 559f436e87f44f5d825bba3fa18f9def Aug 31 12:59:00.594677 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Name: tempest-VolumesNegativeTest-1400280582 Aug 31 12:59:00.594677 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Role: member,reader Aug 31 12:59:00.594677 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Roles: member,reader Aug 31 12:59:00.596137 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_559f436e87f44f5d825bba3fa18f9def"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/559f436e87f44f5d825bba3fa18f9def"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/559f436e87f44f5d825bba3fa18f9def"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/559f436e87f44f5d825bba3fa18f9def"}]}] Aug 31 12:59:00.596137 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant: tempest-VolumesNegativeTest-1400280582 Aug 31 12:59:00.596137 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Id: 559f436e87f44f5d825bba3fa18f9def Aug 31 12:59:00.596137 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Name: tempest-VolumesNegativeTest-1400280582 Aug 31 12:59:00.596137 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User: tempest-VolumesNegativeTest-1400280582-project Aug 31 12:59:00.596137 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Id: default Aug 31 12:59:00.596137 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Name: Default Aug 31 12:59:00.596137 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Id: a836d570eeb341ee966b895a2f11c721 Aug 31 12:59:00.596137 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Name: tempest-VolumesNegativeTest-1400280582-project Aug 31 12:59:00.596137 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: method: Aug 31 12:59:00.596137 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: exception: Volume 9a03a1c9-5fa4-4b8d-a81f-db62861b097e could not be found. Aug 31 12:59:00.596137 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: action_args: {'id': '9a03a1c9-5fa4-4b8d-a81f-db62861b097e'} Aug 31 12:59:00.596137 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:59:00.597027 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:59:00.597027 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 12:59:00.597027 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 12:59:00.597027 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 12:59:00.597027 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 12:59:00.597027 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 12:59:00.597027 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 12:59:00.597027 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 12:59:00.597027 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 12:59:00.597027 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 12:59:00.597027 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 12:59:00.597027 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:59:00.597027 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:59:00.597027 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:59:00.597027 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:59:00.597027 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9a03a1c9-5fa4-4b8d-a81f-db62861b097e could not be found. (HTTP 404) (Request-ID: req-549618ff-9d84-487b-b1f1-929e2a66b22e) Aug 31 12:59:00.597027 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:59:00.597027 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:59:00.597027 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:59:00.598129 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:59:00.598129 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 12:59:00.598129 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 12:59:00.598129 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 12:59:00.598129 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 12:59:00.598129 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 12:59:00.598129 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 12:59:00.598129 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 12:59:00.598129 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 12:59:00.598129 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 12:59:00.598129 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 12:59:00.598129 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 12:59:00.598129 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 12:59:00.598129 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 12:59:00.598129 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 12:59:00.598129 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 12:59:00.598129 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 12:59:00.598129 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 12:59:00.598129 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 12:59:00.599308 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:59:00.599308 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:59:00.599308 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:59:00.599308 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:59:00.599308 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9a03a1c9-5fa4-4b8d-a81f-db62861b097e could not be found. Aug 31 12:59:00.599308 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:59:00.599308 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:59:00.599308 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:59:00.599308 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:59:00.599308 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:59:00.599308 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:59:00.599308 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:59:00.599308 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:59:00.599308 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 12:59:00.599308 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 12:59:00.599308 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:59:00.599308 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:59:00.599308 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 12:59:00.599308 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:59:00.600460 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9a03a1c9-5fa4-4b8d-a81f-db62861b097e could not be found. Aug 31 12:59:00.600460 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:59:00.600460 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:59:00.600460 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:59:00.600460 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:59:00.600460 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:59:00.600460 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:59:00.600460 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:59:00.600460 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:59:00.600460 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9a03a1c9-5fa4-4b8d-a81f-db62861b097e could not be found. Aug 31 12:59:00.600460 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:59:00.602541 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-4012a002-51ba-4a6c-b90f-10e4bc6bb9f5 tempest-VolumesNegativeTest-1400280582 tempest-VolumesNegativeTest-1400280582-project] Returning 404 to user: Volume 9a03a1c9-5fa4-4b8d-a81f-db62861b097e could not be found. {{(pid=120704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:59:00.603484 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-4012a002-51ba-4a6c-b90f-10e4bc6bb9f5 tempest-VolumesNegativeTest-1400280582 tempest-VolumesNegativeTest-1400280582-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/9a03a1c9-5fa4-4b8d-a81f-db62861b097e" status: 404 len: 109 microversion: 2.1 time: 0.164318 Aug 31 12:59:00.608111 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 7/7] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 31 12:59:00 2022] DELETE /compute/v2.1/os-volumes/9a03a1c9-5fa4-4b8d-a81f-db62861b097e => generated 109 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:59:00.614425 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-1edf8dcf-c158-4d74-bab1-aa847f1d9ee9 tempest-VolumesNegativeTest-1400280582 tempest-VolumesNegativeTest-1400280582-project] Calling method '.version_select at 0x7f19521745e0>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:01.271224 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.wsgi [None req-1edf8dcf-c158-4d74-bab1-aa847f1d9ee9 tempest-VolumesNegativeTest-1400280582 tempest-VolumesNegativeTest-1400280582-project] HTTP exception thrown: Volume 28ed889f-975f-46e6-87cd-7be3412268c4 could not be found. Aug 31 12:59:01.276087 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-1edf8dcf-c158-4d74-bab1-aa847f1d9ee9 tempest-VolumesNegativeTest-1400280582 tempest-VolumesNegativeTest-1400280582-project] Request method failure captured: Aug 31 12:59:01.276087 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: request: GET /compute/v2.1/os-volumes/28ed889f-975f-46e6-87cd-7be3412268c4 HTTP/1.1 Aug 31 12:59:01.276087 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept: application/json Aug 31 12:59:01.276087 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept-Encoding: identity Aug 31 12:59:01.276087 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Connection: close Aug 31 12:59:01.276087 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Length: 0 Aug 31 12:59:01.276087 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Type: application/json Aug 31 12:59:01.276087 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Host: 10.222.0.58 Aug 31 12:59:01.276087 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Openstack-System-Scope: None Aug 31 12:59:01.276087 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: User-Agent: python-urllib3/1.26.12 Aug 31 12:59:01.276087 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Auth-Token: gAAAAABjD1sRT373NXh70i5lncaR3HY8hPN9P5l5HNv6cmZMVDqT2CNcKfA_o9dv7tMu3pR28GGYBM9Vw5z97zvT_QMe2YOTtKZ9gn94OGKcYclLKFOYGycYCmDdbO5tDmmbyrhY9RquOWKL05Ro1yTg50_ezSa0Wj2gJzHobMEimxov2OUd6WU Aug 31 12:59:01.276087 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Id: None Aug 31 12:59:01.276087 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Name: None Aug 31 12:59:01.276087 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Identity-Status: Confirmed Aug 31 12:59:01.276087 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Is-Admin-Project: True Aug 31 12:59:01.276087 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Id: default Aug 31 12:59:01.276087 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Name: Default Aug 31 12:59:01.276087 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Id: 559f436e87f44f5d825bba3fa18f9def Aug 31 12:59:01.276087 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Name: tempest-VolumesNegativeTest-1400280582 Aug 31 12:59:01.276087 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Role: member,reader Aug 31 12:59:01.276087 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Roles: member,reader Aug 31 12:59:01.277000 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_559f436e87f44f5d825bba3fa18f9def"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/559f436e87f44f5d825bba3fa18f9def"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/559f436e87f44f5d825bba3fa18f9def"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/559f436e87f44f5d825bba3fa18f9def"}]}] Aug 31 12:59:01.277000 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant: tempest-VolumesNegativeTest-1400280582 Aug 31 12:59:01.277000 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Id: 559f436e87f44f5d825bba3fa18f9def Aug 31 12:59:01.277000 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Name: tempest-VolumesNegativeTest-1400280582 Aug 31 12:59:01.277000 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User: tempest-VolumesNegativeTest-1400280582-project Aug 31 12:59:01.277000 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Id: default Aug 31 12:59:01.277000 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Name: Default Aug 31 12:59:01.277000 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Id: a836d570eeb341ee966b895a2f11c721 Aug 31 12:59:01.277000 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Name: tempest-VolumesNegativeTest-1400280582-project Aug 31 12:59:01.277000 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: method: Aug 31 12:59:01.277000 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: exception: Volume 28ed889f-975f-46e6-87cd-7be3412268c4 could not be found. Aug 31 12:59:01.277000 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: action_args: {'id': '28ed889f-975f-46e6-87cd-7be3412268c4'} Aug 31 12:59:01.277000 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:59:01.277730 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:59:01.277730 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 12:59:01.277730 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 12:59:01.277730 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 12:59:01.277730 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 12:59:01.277730 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 12:59:01.277730 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 12:59:01.277730 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 12:59:01.277730 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 12:59:01.277730 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 12:59:01.277730 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 12:59:01.277730 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:59:01.277730 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:59:01.277730 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:59:01.277730 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:59:01.277730 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 28ed889f-975f-46e6-87cd-7be3412268c4 could not be found. (HTTP 404) (Request-ID: req-c12f37e1-c84d-492f-a52d-420efd123c06) Aug 31 12:59:01.277730 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:59:01.277730 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:59:01.277730 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:59:01.278545 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:59:01.278545 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 12:59:01.278545 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 12:59:01.278545 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 12:59:01.278545 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 12:59:01.278545 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 12:59:01.278545 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 12:59:01.278545 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 12:59:01.278545 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 12:59:01.278545 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 12:59:01.278545 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 12:59:01.278545 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 12:59:01.278545 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 12:59:01.278545 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 12:59:01.278545 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 12:59:01.278545 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 12:59:01.278545 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 12:59:01.278545 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 12:59:01.278545 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 12:59:01.279954 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:59:01.279954 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:59:01.279954 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:59:01.279954 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:59:01.279954 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 28ed889f-975f-46e6-87cd-7be3412268c4 could not be found. Aug 31 12:59:01.279954 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:59:01.279954 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:59:01.279954 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:59:01.279954 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:59:01.279954 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:59:01.279954 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:59:01.279954 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:59:01.279954 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:59:01.279954 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 12:59:01.279954 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 12:59:01.279954 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:59:01.279954 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:59:01.279954 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 12:59:01.279954 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:59:01.282396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 28ed889f-975f-46e6-87cd-7be3412268c4 could not be found. Aug 31 12:59:01.282396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:59:01.282396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:59:01.282396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:59:01.282396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:59:01.282396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:59:01.282396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:59:01.282396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:59:01.282396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:59:01.282396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 28ed889f-975f-46e6-87cd-7be3412268c4 could not be found. Aug 31 12:59:01.282396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:59:01.282396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-1edf8dcf-c158-4d74-bab1-aa847f1d9ee9 tempest-VolumesNegativeTest-1400280582 tempest-VolumesNegativeTest-1400280582-project] Returning 404 to user: Volume 28ed889f-975f-46e6-87cd-7be3412268c4 could not be found. {{(pid=120704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:59:01.282396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-1edf8dcf-c158-4d74-bab1-aa847f1d9ee9 tempest-VolumesNegativeTest-1400280582 tempest-VolumesNegativeTest-1400280582-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/28ed889f-975f-46e6-87cd-7be3412268c4" status: 404 len: 109 microversion: 2.1 time: 0.667982 Aug 31 12:59:01.282396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 8/8] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 31 12:59:00 2022] GET /compute/v2.1/os-volumes/28ed889f-975f-46e6-87cd-7be3412268c4 => generated 109 bytes in 669 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:59:01.297513 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-b25ace9d-58a3-401b-ab20-5d759a91595d tempest-VolumesTestJSON-925372039 tempest-VolumesTestJSON-925372039-project] Calling method '.version_select at 0x7f19521745e0>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:01.699906 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-b25ace9d-58a3-401b-ab20-5d759a91595d tempest-VolumesTestJSON-925372039 tempest-VolumesTestJSON-925372039-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/366db080-5a38-4ede-8646-33c499904b2d" status: 200 len: 350 microversion: 2.1 time: 0.419703 Aug 31 12:59:01.712267 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 9/9] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 31 12:59:01 2022] GET /compute/v2.1/os-volumes/366db080-5a38-4ede-8646-33c499904b2d => generated 350 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:59:01.750548 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-3e6e10e8-9f59-45f9-967e-7d539030ed7a tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.140340 Aug 31 12:59:01.751595 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 1/10] 10.222.0.58 () {60 vars in 1155 bytes} [Wed Aug 31 12:58:57 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4143 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 31 12:59:01.768048 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-b733352d-6b52-4b6b-817a-48029b492ead tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] Calling method '.version_select at 0x7f195220f310>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:02.272100 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-b733352d-6b52-4b6b-817a-48029b492ead tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/c72510d7-eef1-486b-a2a0-46c2281ab522" status: 200 len: 345 microversion: 2.1 time: 0.510058 Aug 31 12:59:02.272992 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 10/11] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 31 12:59:01 2022] GET /compute/v2.1/os-volumes/c72510d7-eef1-486b-a2a0-46c2281ab522 => generated 345 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:59:03.288572 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-12ce0f4e-3b0c-4e54-8a50-1347c8284892 tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] Calling method '.version_select at 0x7f19521e8ca0>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:03.431655 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-12ce0f4e-3b0c-4e54-8a50-1347c8284892 tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/c72510d7-eef1-486b-a2a0-46c2281ab522" status: 200 len: 346 microversion: 2.1 time: 0.149032 Aug 31 12:59:03.439414 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 2/12] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 31 12:59:03 2022] GET /compute/v2.1/os-volumes/c72510d7-eef1-486b-a2a0-46c2281ab522 => generated 346 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:59:03.445965 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-4679e0de-61b1-44fe-9619-8ea39dbccbf9 tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] Action: 'create', calling method: .version_select at 0x7f19521fe310>, body: {"snapshot": {"volume_id": "c72510d7-eef1-486b-a2a0-46c2281ab522", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1633017256"}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:59:03.446396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-b090136b-5dd5-4e0d-93f5-040ffeb3f2de tempest-VolumesTestJSON-925372039 tempest-VolumesTestJSON-925372039-project] Calling method '.version_select at 0x7f195210c5e0>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:03.608835 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-b090136b-5dd5-4e0d-93f5-040ffeb3f2de tempest-VolumesTestJSON-925372039 tempest-VolumesTestJSON-925372039-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/b231d7fb-4657-4e88-a943-388304afe5ef" status: 200 len: 350 microversion: 2.1 time: 0.167060 Aug 31 12:59:03.617125 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 11/13] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 31 12:59:03 2022] GET /compute/v2.1/os-volumes/b231d7fb-4657-4e88-a943-388304afe5ef => generated 350 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:59:03.958483 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-4679e0de-61b1-44fe-9619-8ea39dbccbf9 tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] 10.222.0.58 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.516364 Aug 31 12:59:03.959795 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 3/14] 10.222.0.58 () {60 vars in 1162 bytes} [Wed Aug 31 12:59:03 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:59:03.975726 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-9cf754ed-0526-470a-9a50-94566adf61c7 tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] Calling method '.version_select at 0x7f195210caf0>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:04.397378 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-9cf754ed-0526-470a-9a50-94566adf61c7 tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/d3ff36ee-9fe0-4016-8902-aa90f7549581" status: 200 len: 287 microversion: 2.1 time: 0.430069 Aug 31 12:59:04.397960 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 12/15] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 31 12:59:03 2022] GET /compute/v2.1/os-snapshots/d3ff36ee-9fe0-4016-8902-aa90f7549581 => generated 287 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:59:04.410906 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-2697d52d-16e8-4d77-805b-da668a735c6e tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] Calling method '.version_select at 0x7f19522034c0>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:04.607725 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-2697d52d-16e8-4d77-805b-da668a735c6e tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.202376 Aug 31 12:59:04.611232 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 4/16] 10.222.0.58 () {58 vars in 1140 bytes} [Wed Aug 31 12:59:04 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:59:04.627365 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-26738484-79d4-42bc-93c6-f23250ce1948 tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] Calling method '.version_select at 0x7f1952174550>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:04.736822 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-26738484-79d4-42bc-93c6-f23250ce1948 tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/d3ff36ee-9fe0-4016-8902-aa90f7549581" status: 200 len: 287 microversion: 2.1 time: 0.117492 Aug 31 12:59:04.739067 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 13/17] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 31 12:59:04 2022] GET /compute/v2.1/os-snapshots/d3ff36ee-9fe0-4016-8902-aa90f7549581 => generated 287 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:59:05.750752 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-2182e816-a94c-4452-95b9-0ff6922d7191 tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] Calling method '.version_select at 0x7f19521fe280>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:05.793772 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-2182e816-a94c-4452-95b9-0ff6922d7191 tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/d3ff36ee-9fe0-4016-8902-aa90f7549581" status: 200 len: 287 microversion: 2.1 time: 0.046004 Aug 31 12:59:05.794537 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 5/18] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 31 12:59:05 2022] GET /compute/v2.1/os-snapshots/d3ff36ee-9fe0-4016-8902-aa90f7549581 => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:59:06.662574 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-d9f69333-b3c7-4705-a397-13f8759f0532 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-707611379", "imageRef": "2aa55919-0f25-4e84-a2e1-f60acbe208b2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:59:06.807175 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-fb5d422d-1734-42b5-8405-6d9aa873c580 tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] Calling method '.version_select at 0x7f19521e8af0>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:06.900692 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-fb5d422d-1734-42b5-8405-6d9aa873c580 tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/d3ff36ee-9fe0-4016-8902-aa90f7549581" status: 200 len: 287 microversion: 2.1 time: 0.097413 Aug 31 12:59:06.901506 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 6/19] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 31 12:59:06 2022] GET /compute/v2.1/os-snapshots/d3ff36ee-9fe0-4016-8902-aa90f7549581 => generated 287 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:59:07.037978 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.network.neutron [None req-d9f69333-b3c7-4705-a397-13f8759f0532 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] validate_networks() for [('74e15830-8545-4f59-8ae1-57a628ad41c6', None, None, None, None, None)] {{(pid=120704) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 12:59:07.913166 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-66d9d7b5-739b-4414-9e72-465d359fb49f tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] Calling method '.version_select at 0x7f19522030d0>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:08.029366 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-66d9d7b5-739b-4414-9e72-465d359fb49f tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/d3ff36ee-9fe0-4016-8902-aa90f7549581" status: 200 len: 287 microversion: 2.1 time: 0.120539 Aug 31 12:59:08.030366 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 7/20] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 31 12:59:07 2022] GET /compute/v2.1/os-snapshots/d3ff36ee-9fe0-4016-8902-aa90f7549581 => generated 287 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:59:09.043182 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b707c440-f498-4c61-9af5-c597a26963a6 tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] Calling method '.version_select at 0x7f19521e8b80>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:09.108505 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b707c440-f498-4c61-9af5-c597a26963a6 tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/d3ff36ee-9fe0-4016-8902-aa90f7549581" status: 200 len: 287 microversion: 2.1 time: 0.069412 Aug 31 12:59:09.109332 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 8/21] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 31 12:59:09 2022] GET /compute/v2.1/os-snapshots/d3ff36ee-9fe0-4016-8902-aa90f7549581 => generated 287 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:59:09.529420 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.virt.hardware [None req-d9f69333-b3c7-4705-a397-13f8759f0532 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Flavor limits 0:0:0 {{(pid=120704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 12:59:09.529420 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.virt.hardware [None req-d9f69333-b3c7-4705-a397-13f8759f0532 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Image limits 0:0:0 {{(pid=120704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 12:59:09.530011 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.virt.hardware [None req-d9f69333-b3c7-4705-a397-13f8759f0532 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Flavor pref 0:0:0 {{(pid=120704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 12:59:09.531370 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.virt.hardware [None req-d9f69333-b3c7-4705-a397-13f8759f0532 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Image pref 0:0:0 {{(pid=120704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 12:59:09.531971 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.virt.hardware [None req-d9f69333-b3c7-4705-a397-13f8759f0532 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 12:59:09.563501 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d9f69333-b3c7-4705-a397-13f8759f0532 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:09.566722 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d9f69333-b3c7-4705-a397-13f8759f0532 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:09.567377 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d9f69333-b3c7-4705-a397-13f8759f0532 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:09.571328 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d9f69333-b3c7-4705-a397-13f8759f0532 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:09.572129 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d9f69333-b3c7-4705-a397-13f8759f0532 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:09.573779 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d9f69333-b3c7-4705-a397-13f8759f0532 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:09.653451 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.quota [None req-d9f69333-b3c7-4705-a397-13f8759f0532 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Getting quotas for project b5b2950890c04cff868553069d6aba9a. Resources: {'instances', 'ram', 'cores'} {{(pid=120704) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:59:09.667646 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.quota [None req-d9f69333-b3c7-4705-a397-13f8759f0532 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Getting quotas for user 32770594db4f437a958fd8c2c145a865 and project b5b2950890c04cff868553069d6aba9a. Resources: {'instances', 'ram', 'cores'} {{(pid=120704) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:59:09.707358 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-d9f69333-b3c7-4705-a397-13f8759f0532 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Going to run 1 instances... {{(pid=120704) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 12:59:09.716264 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-d9f69333-b3c7-4705-a397-13f8759f0532 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: f97b98c1-e7be-4c90-8c65-715135db482b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2aa55919-0f25-4e84-a2e1-f60acbe208b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120704) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 12:59:09.837359 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3aaa0161-d01b-406f-bc1c-ca96942be92f tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1059652613", "imageRef": "2aa55919-0f25-4e84-a2e1-f60acbe208b2", "flavorRef": "452", "networks": [{"uuid": "b016abfe-4a4b-4811-b6b8-b309d5523dce"}]}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:59:09.929949 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-d9f69333-b3c7-4705-a397-13f8759f0532 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.746523 Aug 31 12:59:09.942200 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 14/22] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 31 12:59:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 3760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 12:59:09.952346 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-922f1ff8-f270-47d6-baa4-97e54f255430 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:09.952950 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-922f1ff8-f270-47d6-baa4-97e54f255430 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: f97b98c1-e7be-4c90-8c65-715135db482b] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:10.043115 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.network.neutron [None req-3aaa0161-d01b-406f-bc1c-ca96942be92f tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] validate_networks() for [('b016abfe-4a4b-4811-b6b8-b309d5523dce', None, None, None, None, None)] {{(pid=120705) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 12:59:10.323141 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-922f1ff8-f270-47d6-baa4-97e54f255430 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:10.349612 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-922f1ff8-f270-47d6-baa4-97e54f255430 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b" status: 200 len: 1221 microversion: 2.1 time: 0.403461 Aug 31 12:59:10.350486 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 15/23] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:09 2022] GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b => generated 1221 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:10.356699 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-b2e97b8c-db00-46c0-acd2-1a42548a34c5 tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] Calling method '.version_select at 0x7f1951818ca0>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:10.444684 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-b2e97b8c-db00-46c0-acd2-1a42548a34c5 tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/d3ff36ee-9fe0-4016-8902-aa90f7549581" status: 200 len: 287 microversion: 2.1 time: 0.092942 Aug 31 12:59:10.447987 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 16/24] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 31 12:59:10 2022] GET /compute/v2.1/os-snapshots/d3ff36ee-9fe0-4016-8902-aa90f7549581 => generated 287 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:59:10.622821 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-1a487823-f667-482a-a006-994a21e55e31 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Action: 'create', calling method: .version_select at 0x7f19518405e0>, body: {"keypair": {"name": "tempest-keypair-1036327267", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA9wYXEkd7QBkr/FP0m0qgVA2b9VeLQbkiIpfoklKwDN7XOdV2VRazbf8340hvvHBIcfpBaNkSoeOEwdllPg80XWlm/SVNqLRr5q2/nOAX0I0rVeTcBrB72bgnUh9PgnYQ=="}} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:59:10.704467 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.quota [None req-1a487823-f667-482a-a006-994a21e55e31 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Getting quotas for project 58fa7489cdff42fcb41727a407a110a4. Resources: {'key_pairs'} {{(pid=120704) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:59:10.715554 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.quota [None req-1a487823-f667-482a-a006-994a21e55e31 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Getting quotas for user 65b1d441346f482e9981b1fa4015ea63 and project 58fa7489cdff42fcb41727a407a110a4. Resources: {'key_pairs'} {{(pid=120704) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:59:10.819644 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-1a487823-f667-482a-a006-994a21e55e31 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.370189 Aug 31 12:59:10.828606 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 17/25] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 31 12:59:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:59:10.838579 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-d534a4a2-c62b-4ad2-b9e5-279ef63b0cbb tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-921584606", "imageRef": "2aa55919-0f25-4e84-a2e1-f60acbe208b2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:59:10.961000 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.network.neutron [None req-d534a4a2-c62b-4ad2-b9e5-279ef63b0cbb tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] validate_networks() for [('74e15830-8545-4f59-8ae1-57a628ad41c6', None, None, None, None, None)] {{(pid=120704) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 12:59:12.277153 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-3aaa0161-d01b-406f-bc1c-ca96942be92f tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Flavor limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 12:59:12.277695 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-3aaa0161-d01b-406f-bc1c-ca96942be92f tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Image limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 12:59:12.278115 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-3aaa0161-d01b-406f-bc1c-ca96942be92f tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Flavor pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 12:59:12.280926 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-3aaa0161-d01b-406f-bc1c-ca96942be92f tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Image pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 12:59:12.282979 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-3aaa0161-d01b-406f-bc1c-ca96942be92f tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 12:59:12.360451 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3aaa0161-d01b-406f-bc1c-ca96942be92f tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:12.364372 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3aaa0161-d01b-406f-bc1c-ca96942be92f tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:12.369209 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3aaa0161-d01b-406f-bc1c-ca96942be92f tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:12.370114 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3aaa0161-d01b-406f-bc1c-ca96942be92f tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:12.373502 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3aaa0161-d01b-406f-bc1c-ca96942be92f tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:12.374067 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3aaa0161-d01b-406f-bc1c-ca96942be92f tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:12.395117 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.virt.hardware [None req-d534a4a2-c62b-4ad2-b9e5-279ef63b0cbb tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Flavor limits 0:0:0 {{(pid=120704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 12:59:12.396301 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.virt.hardware [None req-d534a4a2-c62b-4ad2-b9e5-279ef63b0cbb tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Image limits 0:0:0 {{(pid=120704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 12:59:12.396910 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.virt.hardware [None req-d534a4a2-c62b-4ad2-b9e5-279ef63b0cbb tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Flavor pref 0:0:0 {{(pid=120704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 12:59:12.397466 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.virt.hardware [None req-d534a4a2-c62b-4ad2-b9e5-279ef63b0cbb tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Image pref 0:0:0 {{(pid=120704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 12:59:12.398022 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.virt.hardware [None req-d534a4a2-c62b-4ad2-b9e5-279ef63b0cbb tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 12:59:12.416215 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d534a4a2-c62b-4ad2-b9e5-279ef63b0cbb tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:12.416704 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d534a4a2-c62b-4ad2-b9e5-279ef63b0cbb tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:12.418212 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d534a4a2-c62b-4ad2-b9e5-279ef63b0cbb tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:12.420298 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d534a4a2-c62b-4ad2-b9e5-279ef63b0cbb tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:12.421877 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d534a4a2-c62b-4ad2-b9e5-279ef63b0cbb tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:12.425920 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d534a4a2-c62b-4ad2-b9e5-279ef63b0cbb tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:12.457228 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-3aaa0161-d01b-406f-bc1c-ca96942be92f tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Getting quotas for project f0eff3111a5847a68620fce8060df208. Resources: {'instances', 'ram', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:59:12.468061 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.quota [None req-d534a4a2-c62b-4ad2-b9e5-279ef63b0cbb tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Getting quotas for project b5b2950890c04cff868553069d6aba9a. Resources: {'instances', 'ram', 'cores'} {{(pid=120704) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:59:12.479912 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.quota [None req-d534a4a2-c62b-4ad2-b9e5-279ef63b0cbb tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Getting quotas for user 32770594db4f437a958fd8c2c145a865 and project b5b2950890c04cff868553069d6aba9a. Resources: {'instances', 'ram', 'cores'} {{(pid=120704) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:59:12.489317 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-3aaa0161-d01b-406f-bc1c-ca96942be92f tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Getting quotas for user 76b63adaf56e417cba603f908a8e451c and project f0eff3111a5847a68620fce8060df208. Resources: {'instances', 'ram', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:59:12.504655 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-d534a4a2-c62b-4ad2-b9e5-279ef63b0cbb tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Going to run 1 instances... {{(pid=120704) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 12:59:12.506888 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-d534a4a2-c62b-4ad2-b9e5-279ef63b0cbb tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2aa55919-0f25-4e84-a2e1-f60acbe208b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120704) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 12:59:12.519972 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-3aaa0161-d01b-406f-bc1c-ca96942be92f tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Going to run 1 instances... {{(pid=120705) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 12:59:12.525475 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-3aaa0161-d01b-406f-bc1c-ca96942be92f tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2aa55919-0f25-4e84-a2e1-f60acbe208b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120705) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 12:59:12.668524 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-d534a4a2-c62b-4ad2-b9e5-279ef63b0cbb tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.838339 Aug 31 12:59:12.669206 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-3aaa0161-d01b-406f-bc1c-ca96942be92f tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.071439 Aug 31 12:59:12.671856 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 9/26] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 31 12:59:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 3075 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 12:59:12.678870 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 18/27] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 31 12:59:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 1849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 12:59:12.680705 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e3188183-9321-486d-ab07-bc46837a6f68 tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] Calling method '.version_select at 0x7f19518994c0>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:12.691642 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-c385b841-abd8-4917-9e72-7f5fbb69edd9 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:12.692964 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-c385b841-abd8-4917-9e72-7f5fbb69edd9 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:12.813732 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e3188183-9321-486d-ab07-bc46837a6f68 tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/d3ff36ee-9fe0-4016-8902-aa90f7549581" status: 200 len: 288 microversion: 2.1 time: 0.139682 Aug 31 12:59:12.814831 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 10/28] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 31 12:59:12 2022] GET /compute/v2.1/os-snapshots/d3ff36ee-9fe0-4016-8902-aa90f7549581 => generated 288 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:59:12.820158 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-590cf040-eb24-4d01-9c65-9d8029279b92 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:12.821176 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-590cf040-eb24-4d01-9c65-9d8029279b92 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:13.023285 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-c385b841-abd8-4917-9e72-7f5fbb69edd9 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63adaf56e417cba603f908a8e451c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0eff3111a5847a68620fce8060df208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:13.037276 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-c385b841-abd8-4917-9e72-7f5fbb69edd9 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 200 len: 1215 microversion: 2.1 time: 0.356898 Aug 31 12:59:13.061647 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 19/29] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:12 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 1215 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:13.069333 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-627c2386-603b-4186-b23c-cd7dad3b37b3 tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] Calling method '.version_select at 0x7f19517ca820>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:13.203315 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-627c2386-603b-4186-b23c-cd7dad3b37b3 tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] 10.222.0.58 "DELETE /compute/v2.1/os-snapshots/d3ff36ee-9fe0-4016-8902-aa90f7549581" status: 202 len: 0 microversion: 2.1 time: 0.140074 Aug 31 12:59:13.203980 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 20/30] 10.222.0.58 () {58 vars in 1254 bytes} [Wed Aug 31 12:59:13 2022] DELETE /compute/v2.1/os-snapshots/d3ff36ee-9fe0-4016-8902-aa90f7549581 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:59:13.212441 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-e8f7c7a6-2b19-4462-ad31-a5752f4c05c2 tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] Calling method '.version_select at 0x7f19517e44c0>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:13.278567 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-e8f7c7a6-2b19-4462-ad31-a5752f4c05c2 tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/d3ff36ee-9fe0-4016-8902-aa90f7549581" status: 200 len: 287 microversion: 2.1 time: 0.069794 Aug 31 12:59:13.279308 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 21/31] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 31 12:59:13 2022] GET /compute/v2.1/os-snapshots/d3ff36ee-9fe0-4016-8902-aa90f7549581 => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:59:13.492784 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-590cf040-eb24-4d01-9c65-9d8029279b92 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:13.542414 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-590cf040-eb24-4d01-9c65-9d8029279b92 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1221 microversion: 2.1 time: 0.726219 Aug 31 12:59:13.545975 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 11/32] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:12 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1221 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:14.073291 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-68d82ba1-8836-4d85-be95-6fe80e6b953e tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:14.076391 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-68d82ba1-8836-4d85-be95-6fe80e6b953e tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:14.095035 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-68d82ba1-8836-4d85-be95-6fe80e6b953e tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:14.095861 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-68d82ba1-8836-4d85-be95-6fe80e6b953e tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:14.096344 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-68d82ba1-8836-4d85-be95-6fe80e6b953e tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:14.097016 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-68d82ba1-8836-4d85-be95-6fe80e6b953e tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:14.097468 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-68d82ba1-8836-4d85-be95-6fe80e6b953e tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:14.097891 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-68d82ba1-8836-4d85-be95-6fe80e6b953e tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:14.290985 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-36a8df31-af03-436a-a81f-a468257dc16a tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] Calling method '.version_select at 0x7f19518998b0>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:14.305102 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-68d82ba1-8836-4d85-be95-6fe80e6b953e tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63adaf56e417cba603f908a8e451c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0eff3111a5847a68620fce8060df208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:14.321800 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-68d82ba1-8836-4d85-be95-6fe80e6b953e tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 200 len: 1219 microversion: 2.1 time: 0.256008 Aug 31 12:59:14.335491 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 22/33] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:14 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 1219 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:14.351803 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-36a8df31-af03-436a-a81f-a468257dc16a tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/d3ff36ee-9fe0-4016-8902-aa90f7549581" status: 200 len: 287 microversion: 2.1 time: 0.064845 Aug 31 12:59:14.352701 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 12/34] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 31 12:59:14 2022] GET /compute/v2.1/os-snapshots/d3ff36ee-9fe0-4016-8902-aa90f7549581 => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:59:14.591717 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-34fc9b19-bb43-4823-ac29-921d12319f03 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:14.609527 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-34fc9b19-bb43-4823-ac29-921d12319f03 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:14.638841 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-34fc9b19-bb43-4823-ac29-921d12319f03 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:14.639346 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-34fc9b19-bb43-4823-ac29-921d12319f03 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:14.649022 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-34fc9b19-bb43-4823-ac29-921d12319f03 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:14.651019 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-34fc9b19-bb43-4823-ac29-921d12319f03 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:14.654411 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-34fc9b19-bb43-4823-ac29-921d12319f03 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:14.655046 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-34fc9b19-bb43-4823-ac29-921d12319f03 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:14.792772 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-031670f7-2eb5-40d7-807d-a4a8a96b0c31 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1680400484", "imageRef": "2aa55919-0f25-4e84-a2e1-f60acbe208b2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "05644ee5-e646-4d3c-975e-ff7be4b6494e"}], "security_groups": [{"name": "tempest-securitygroup--115179226"}], "key_name": "tempest-keypair-1036327267", "user_data": "}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:59:14.890029 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-34fc9b19-bb43-4823-ac29-921d12319f03 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:14.899443 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-34fc9b19-bb43-4823-ac29-921d12319f03 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1225 microversion: 2.1 time: 0.325060 Aug 31 12:59:14.904642 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 23/35] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:14 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1225 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:15.123142 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.network.neutron [None req-031670f7-2eb5-40d7-807d-a4a8a96b0c31 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] validate_networks() for [('05644ee5-e646-4d3c-975e-ff7be4b6494e', None, None, None, None, None)] {{(pid=120705) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 12:59:15.342655 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-c2f673aa-71c1-4a8e-bc2b-11de0cd6e99d tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:15.348527 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-c2f673aa-71c1-4a8e-bc2b-11de0cd6e99d tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:15.363637 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c2f673aa-71c1-4a8e-bc2b-11de0cd6e99d tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:15.366223 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c2f673aa-71c1-4a8e-bc2b-11de0cd6e99d tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:15.366880 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c2f673aa-71c1-4a8e-bc2b-11de0cd6e99d tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:15.369770 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c2f673aa-71c1-4a8e-bc2b-11de0cd6e99d tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:15.370476 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c2f673aa-71c1-4a8e-bc2b-11de0cd6e99d tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:15.370916 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c2f673aa-71c1-4a8e-bc2b-11de0cd6e99d tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:15.475727 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-c2f673aa-71c1-4a8e-bc2b-11de0cd6e99d tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63adaf56e417cba603f908a8e451c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0eff3111a5847a68620fce8060df208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:15.504532 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-c2f673aa-71c1-4a8e-bc2b-11de0cd6e99d tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 200 len: 1267 microversion: 2.1 time: 0.165384 Aug 31 12:59:15.509357 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 24/36] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:15 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:15.518780 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-65022fc7-e655-41ec-a3ee-d0e583b3444b tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] Calling method '.version_select at 0x7f1951763ca0>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:15.606986 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-65022fc7-e655-41ec-a3ee-d0e583b3444b tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/d3ff36ee-9fe0-4016-8902-aa90f7549581" status: 200 len: 287 microversion: 2.1 time: 0.095790 Aug 31 12:59:15.607698 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 25/37] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 31 12:59:15 2022] GET /compute/v2.1/os-snapshots/d3ff36ee-9fe0-4016-8902-aa90f7549581 => generated 287 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:59:15.728428 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-af964a7f-9302-474f-b37e-b144a1027687 tempest-VolumesTestJSON-925372039 tempest-VolumesTestJSON-925372039-project] Calling method '.version_select at 0x7f19517845e0>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:15.754513 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-031670f7-2eb5-40d7-807d-a4a8a96b0c31 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Flavor limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 12:59:15.754943 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-031670f7-2eb5-40d7-807d-a4a8a96b0c31 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Image limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 12:59:15.755410 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-031670f7-2eb5-40d7-807d-a4a8a96b0c31 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Flavor pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 12:59:15.756043 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-031670f7-2eb5-40d7-807d-a4a8a96b0c31 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Image pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 12:59:15.756804 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-031670f7-2eb5-40d7-807d-a4a8a96b0c31 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 12:59:15.777681 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-031670f7-2eb5-40d7-807d-a4a8a96b0c31 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:15.778430 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-031670f7-2eb5-40d7-807d-a4a8a96b0c31 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:15.778871 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-031670f7-2eb5-40d7-807d-a4a8a96b0c31 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:15.779903 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-031670f7-2eb5-40d7-807d-a4a8a96b0c31 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:15.780504 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-031670f7-2eb5-40d7-807d-a4a8a96b0c31 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:15.781093 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-031670f7-2eb5-40d7-807d-a4a8a96b0c31 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:15.801191 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-031670f7-2eb5-40d7-807d-a4a8a96b0c31 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Getting quotas for project 58fa7489cdff42fcb41727a407a110a4. Resources: {'instances', 'ram', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:59:15.805918 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-031670f7-2eb5-40d7-807d-a4a8a96b0c31 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Getting quotas for user 65b1d441346f482e9981b1fa4015ea63 and project 58fa7489cdff42fcb41727a407a110a4. Resources: {'instances', 'ram', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:59:15.818354 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-031670f7-2eb5-40d7-807d-a4a8a96b0c31 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Going to run 1 instances... {{(pid=120705) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 12:59:15.821088 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-031670f7-2eb5-40d7-807d-a4a8a96b0c31 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2aa55919-0f25-4e84-a2e1-f60acbe208b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120705) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 12:59:15.878774 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-031670f7-2eb5-40d7-807d-a4a8a96b0c31 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.095875 Aug 31 12:59:15.880903 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 13/38] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 31 12:59:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 1098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 12:59:15.914060 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-daead220-65a0-406d-9924-205c52fb7202 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:15.916562 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-daead220-65a0-406d-9924-205c52fb7202 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:16.014139 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-daead220-65a0-406d-9924-205c52fb7202 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:16.023929 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-daead220-65a0-406d-9924-205c52fb7202 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1238 microversion: 2.1 time: 0.134956 Aug 31 12:59:16.025466 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 14/39] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:15 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1238 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:16.031077 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b23934d8-c7bb-4791-a7ad-e6149139b2c2 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:16.031681 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b23934d8-c7bb-4791-a7ad-e6149139b2c2 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:16.038150 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b23934d8-c7bb-4791-a7ad-e6149139b2c2 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:16.038823 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b23934d8-c7bb-4791-a7ad-e6149139b2c2 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:16.039897 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b23934d8-c7bb-4791-a7ad-e6149139b2c2 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:16.041618 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b23934d8-c7bb-4791-a7ad-e6149139b2c2 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:16.042308 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b23934d8-c7bb-4791-a7ad-e6149139b2c2 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:16.043091 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b23934d8-c7bb-4791-a7ad-e6149139b2c2 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:16.354476 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-b23934d8-c7bb-4791-a7ad-e6149139b2c2 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:16.388530 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b23934d8-c7bb-4791-a7ad-e6149139b2c2 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1273 microversion: 2.1 time: 0.360998 Aug 31 12:59:16.389639 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 15/40] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:16 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1273 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:16.517139 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-af964a7f-9302-474f-b37e-b144a1027687 tempest-VolumesTestJSON-925372039 tempest-VolumesTestJSON-925372039-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/4de641a1-ea7a-4d0f-9579-6b1cd022d4b5" status: 200 len: 351 microversion: 2.1 time: 0.792604 Aug 31 12:59:16.526642 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 26/41] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 31 12:59:15 2022] GET /compute/v2.1/os-volumes/4de641a1-ea7a-4d0f-9579-6b1cd022d4b5 => generated 351 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:59:16.534361 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b6584f8b-983d-4500-aa98-5d938ad2c774 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:16.535376 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b6584f8b-983d-4500-aa98-5d938ad2c774 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:16.540739 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-4dc255be-1dcb-418c-9a47-02cdf6f50695 tempest-VolumesTestJSON-925372039 tempest-VolumesTestJSON-925372039-project] Calling method '.version_select at 0x7f1951735dc0>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:16.567437 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b6584f8b-983d-4500-aa98-5d938ad2c774 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:16.568629 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b6584f8b-983d-4500-aa98-5d938ad2c774 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:16.572386 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b6584f8b-983d-4500-aa98-5d938ad2c774 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:16.575035 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b6584f8b-983d-4500-aa98-5d938ad2c774 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:16.575967 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b6584f8b-983d-4500-aa98-5d938ad2c774 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:16.578561 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b6584f8b-983d-4500-aa98-5d938ad2c774 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:16.816393 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-b6584f8b-983d-4500-aa98-5d938ad2c774 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63adaf56e417cba603f908a8e451c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0eff3111a5847a68620fce8060df208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:16.828386 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b6584f8b-983d-4500-aa98-5d938ad2c774 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 200 len: 1285 microversion: 2.1 time: 0.300164 Aug 31 12:59:16.844887 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 16/42] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:16 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 1285 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:16.869680 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-250d71c6-3b96-4a28-aae4-873adc5233fd tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] Calling method '.version_select at 0x7f1951789a60>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:16.931286 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-4dc255be-1dcb-418c-9a47-02cdf6f50695 tempest-VolumesTestJSON-925372039 tempest-VolumesTestJSON-925372039-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.395557 Aug 31 12:59:16.932179 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 27/43] 10.222.0.58 () {58 vars in 1134 bytes} [Wed Aug 31 12:59:16 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:59:16.946770 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-be7aae0c-7537-4893-ac51-221312819471 tempest-VolumesTestJSON-925372039 tempest-VolumesTestJSON-925372039-project] Calling method '.version_select at 0x7f195176b310>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:16.995592 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-250d71c6-3b96-4a28-aae4-873adc5233fd tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] HTTP exception thrown: Snapshot d3ff36ee-9fe0-4016-8902-aa90f7549581 could not be found. Aug 31 12:59:16.999430 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-250d71c6-3b96-4a28-aae4-873adc5233fd tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] Request method failure captured: Aug 31 12:59:16.999430 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: request: GET /compute/v2.1/os-snapshots/d3ff36ee-9fe0-4016-8902-aa90f7549581 HTTP/1.1 Aug 31 12:59:16.999430 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 31 12:59:16.999430 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 31 12:59:16.999430 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Connection: close Aug 31 12:59:16.999430 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 31 12:59:16.999430 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 31 12:59:16.999430 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Host: 10.222.0.58 Aug 31 12:59:16.999430 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 31 12:59:16.999430 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 31 12:59:16.999430 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjD1sR0nqjRX-9KPmX7yDFRfMG5jxAF5jP-EK63L65ZnQ4Zk84dfc7kJoKBlfJfTclKPPakNjesJNsnfFFwBlmcU2LgLmny_qjndBKETlTC8viHWXNpoSgl569mUFGC4Sqj6eQueE1ZsgU3NVDpmVFnJWfsTNSH_OpQ7vdvWsr_jCwhk0 Aug 31 12:59:16.999430 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 31 12:59:16.999430 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 31 12:59:16.999430 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 31 12:59:16.999430 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 31 12:59:16.999430 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 31 12:59:16.999430 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 31 12:59:16.999430 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Id: 2d5fe55c19724f23a98e4b404f18745b Aug 31 12:59:16.999430 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1011580617 Aug 31 12:59:16.999430 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Role: member,reader Aug 31 12:59:16.999430 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Roles: member,reader Aug 31 12:59:17.000958 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2d5fe55c19724f23a98e4b404f18745b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2d5fe55c19724f23a98e4b404f18745b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2d5fe55c19724f23a98e4b404f18745b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2d5fe55c19724f23a98e4b404f18745b"}]}] Aug 31 12:59:17.000958 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1011580617 Aug 31 12:59:17.000958 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant-Id: 2d5fe55c19724f23a98e4b404f18745b Aug 31 12:59:17.000958 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1011580617 Aug 31 12:59:17.000958 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User: tempest-VolumesSnapshotsTestJSON-1011580617-project Aug 31 12:59:17.000958 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 31 12:59:17.000958 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 31 12:59:17.000958 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Id: 2881550924ad4408bccdbd3ee94cd31e Aug 31 12:59:17.000958 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1011580617-project Aug 31 12:59:17.000958 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: method: Aug 31 12:59:17.000958 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: exception: Snapshot d3ff36ee-9fe0-4016-8902-aa90f7549581 could not be found. Aug 31 12:59:17.000958 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: action_args: {'id': 'd3ff36ee-9fe0-4016-8902-aa90f7549581'} Aug 31 12:59:17.000958 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:59:17.001909 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:59:17.001909 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 31 12:59:17.001909 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 31 12:59:17.001909 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 31 12:59:17.001909 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 31 12:59:17.001909 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 31 12:59:17.001909 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 31 12:59:17.001909 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 12:59:17.001909 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 12:59:17.001909 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 12:59:17.001909 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 12:59:17.001909 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:59:17.001909 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:59:17.001909 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:59:17.001909 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:59:17.001909 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d3ff36ee-9fe0-4016-8902-aa90f7549581 could not be found. (HTTP 404) (Request-ID: req-dfb3c386-7fab-4ef3-916a-67ecd5dbff7a) Aug 31 12:59:17.001909 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 12:59:17.001909 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:59:17.003068 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 12:59:17.003068 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:59:17.003068 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 31 12:59:17.003068 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 31 12:59:17.003068 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 12:59:17.003068 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 12:59:17.003068 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 31 12:59:17.003068 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 31 12:59:17.003068 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 12:59:17.003068 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 12:59:17.003068 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 31 12:59:17.003068 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 31 12:59:17.003068 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 31 12:59:17.003068 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 31 12:59:17.003068 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 31 12:59:17.003068 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 31 12:59:17.003068 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 12:59:17.003068 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 12:59:17.003068 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 12:59:17.004446 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 12:59:17.004446 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:59:17.004446 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:59:17.004446 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:59:17.004446 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:59:17.004446 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d3ff36ee-9fe0-4016-8902-aa90f7549581 could not be found. Aug 31 12:59:17.004446 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 12:59:17.004446 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:59:17.004446 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 12:59:17.004446 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:59:17.004446 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:59:17.004446 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:59:17.004446 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:59:17.004446 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:59:17.004446 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 12:59:17.004446 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 12:59:17.004446 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:59:17.004446 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:59:17.004446 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 31 12:59:17.004446 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:59:17.006027 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d3ff36ee-9fe0-4016-8902-aa90f7549581 could not be found. Aug 31 12:59:17.006027 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 12:59:17.006027 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:59:17.006027 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 12:59:17.006027 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:59:17.006027 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:59:17.006027 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:59:17.006027 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:59:17.006027 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:59:17.006027 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d3ff36ee-9fe0-4016-8902-aa90f7549581 could not be found. Aug 31 12:59:17.006027 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 12:59:17.006027 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-250d71c6-3b96-4a28-aae4-873adc5233fd tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] Returning 404 to user: Snapshot d3ff36ee-9fe0-4016-8902-aa90f7549581 could not be found. {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:59:17.006027 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-250d71c6-3b96-4a28-aae4-873adc5233fd tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/d3ff36ee-9fe0-4016-8902-aa90f7549581" status: 404 len: 111 microversion: 2.1 time: 0.155020 Aug 31 12:59:17.006840 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 17/44] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 31 12:59:16 2022] GET /compute/v2.1/os-snapshots/d3ff36ee-9fe0-4016-8902-aa90f7549581 => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:59:17.022887 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-c100afe9-2f56-4c21-8812-38a062360f91 tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] Calling method '.version_select at 0x7f1951899310>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:17.141068 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-be7aae0c-7537-4893-ac51-221312819471 tempest-VolumesTestJSON-925372039 tempest-VolumesTestJSON-925372039-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.198846 Aug 31 12:59:17.143182 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 28/45] 10.222.0.58 () {58 vars in 1149 bytes} [Wed Aug 31 12:59:16 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:59:17.149671 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-04ab0da8-c8e2-42e7-a9a9-6336eafc8ca5 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:17.151079 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-04ab0da8-c8e2-42e7-a9a9-6336eafc8ca5 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:17.169401 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-04ab0da8-c8e2-42e7-a9a9-6336eafc8ca5 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:17.170485 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-04ab0da8-c8e2-42e7-a9a9-6336eafc8ca5 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:17.171118 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-04ab0da8-c8e2-42e7-a9a9-6336eafc8ca5 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:17.172902 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-04ab0da8-c8e2-42e7-a9a9-6336eafc8ca5 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:17.173829 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-04ab0da8-c8e2-42e7-a9a9-6336eafc8ca5 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:17.174501 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-04ab0da8-c8e2-42e7-a9a9-6336eafc8ca5 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:17.390860 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-c100afe9-2f56-4c21-8812-38a062360f91 tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/c72510d7-eef1-486b-a2a0-46c2281ab522" status: 202 len: 0 microversion: 2.1 time: 0.383358 Aug 31 12:59:17.391918 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 18/46] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 31 12:59:17 2022] DELETE /compute/v2.1/os-volumes/c72510d7-eef1-486b-a2a0-46c2281ab522 => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:59:17.399513 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-da009c79-1d71-4e33-9155-da54d900fa80 tempest-VolumesTestJSON-925372039 tempest-VolumesTestJSON-925372039-project] Calling method '.version_select at 0x7f1951789d30>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:17.458510 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-04ab0da8-c8e2-42e7-a9a9-6336eafc8ca5 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:17.492074 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-04ab0da8-c8e2-42e7-a9a9-6336eafc8ca5 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1234 microversion: 2.1 time: 0.334061 Aug 31 12:59:17.492782 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 29/47] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:17 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1234 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:17.501080 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-60759733-0dd7-4ad9-857a-41a6ddb5513d tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] Calling method '.version_select at 0x7f1951818280>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:17.605909 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-da009c79-1d71-4e33-9155-da54d900fa80 tempest-VolumesTestJSON-925372039 tempest-VolumesTestJSON-925372039-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.212599 Aug 31 12:59:17.606771 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 19/48] 10.222.0.58 () {58 vars in 1134 bytes} [Wed Aug 31 12:59:17 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:17.612181 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-62394b4f-0294-4f2c-993f-8c9af4b58435 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:17.613373 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-62394b4f-0294-4f2c-993f-8c9af4b58435 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:17.632518 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-62394b4f-0294-4f2c-993f-8c9af4b58435 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:17.662904 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-62394b4f-0294-4f2c-993f-8c9af4b58435 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:17.664060 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-62394b4f-0294-4f2c-993f-8c9af4b58435 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:17.668696 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-62394b4f-0294-4f2c-993f-8c9af4b58435 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:17.676490 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-62394b4f-0294-4f2c-993f-8c9af4b58435 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:17.678027 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-62394b4f-0294-4f2c-993f-8c9af4b58435 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:17.711519 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-60759733-0dd7-4ad9-857a-41a6ddb5513d tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/c72510d7-eef1-486b-a2a0-46c2281ab522" status: 200 len: 345 microversion: 2.1 time: 0.217162 Aug 31 12:59:17.712417 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 30/49] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 31 12:59:17 2022] GET /compute/v2.1/os-volumes/c72510d7-eef1-486b-a2a0-46c2281ab522 => generated 345 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:59:17.716998 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-4a6cee05-c673-4b61-857f-717b750c4461 tempest-VolumesTestJSON-925372039 tempest-VolumesTestJSON-925372039-project] Calling method '.version_select at 0x7f19516d3670>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:18.062545 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-4a6cee05-c673-4b61-857f-717b750c4461 tempest-VolumesTestJSON-925372039 tempest-VolumesTestJSON-925372039-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.349054 Aug 31 12:59:18.067057 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 31/50] 10.222.0.58 () {58 vars in 1167 bytes} [Wed Aug 31 12:59:17 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:59:18.074645 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-5d7c9561-8d60-483d-b3d6-18772e577120 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:18.075460 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-5d7c9561-8d60-483d-b3d6-18772e577120 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:18.104470 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5d7c9561-8d60-483d-b3d6-18772e577120 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:18.104984 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5d7c9561-8d60-483d-b3d6-18772e577120 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:18.110716 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5d7c9561-8d60-483d-b3d6-18772e577120 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:18.117341 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5d7c9561-8d60-483d-b3d6-18772e577120 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:18.118111 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5d7c9561-8d60-483d-b3d6-18772e577120 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:18.118634 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5d7c9561-8d60-483d-b3d6-18772e577120 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:18.510587 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-62394b4f-0294-4f2c-993f-8c9af4b58435 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:18.524458 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-62394b4f-0294-4f2c-993f-8c9af4b58435 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1279 microversion: 2.1 time: 0.916146 Aug 31 12:59:18.525518 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 20/51] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:17 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1279 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:18.541457 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-09e929a7-80b2-439b-bf53-c929b14b8a58 tempest-VolumesTestJSON-925372039 tempest-VolumesTestJSON-925372039-project] Calling method '.version_select at 0x7f1951789af0>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:18.759621 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-5d7c9561-8d60-483d-b3d6-18772e577120 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63adaf56e417cba603f908a8e451c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0eff3111a5847a68620fce8060df208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:18.779099 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-5d7c9561-8d60-483d-b3d6-18772e577120 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 200 len: 1273 microversion: 2.1 time: 0.709294 Aug 31 12:59:18.786175 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 32/52] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:18 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 1273 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:18.812811 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-3189b6b8-64b9-4006-9d2e-1147c68343fe tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:18.820914 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-3189b6b8-64b9-4006-9d2e-1147c68343fe tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:18.844864 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-09e929a7-80b2-439b-bf53-c929b14b8a58 tempest-VolumesTestJSON-925372039 tempest-VolumesTestJSON-925372039-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.311621 Aug 31 12:59:18.846155 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 21/53] 10.222.0.58 () {58 vars in 1170 bytes} [Wed Aug 31 12:59:18 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:59:18.856977 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3189b6b8-64b9-4006-9d2e-1147c68343fe tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:18.856977 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3189b6b8-64b9-4006-9d2e-1147c68343fe tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:18.856977 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3189b6b8-64b9-4006-9d2e-1147c68343fe tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:18.856977 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3189b6b8-64b9-4006-9d2e-1147c68343fe tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:18.857338 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3189b6b8-64b9-4006-9d2e-1147c68343fe tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:18.857338 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3189b6b8-64b9-4006-9d2e-1147c68343fe tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:18.863078 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-99fda83b-30c2-4ea2-a12e-5b4abf22cda1 tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] Calling method '.version_select at 0x7f19517f7f70>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:18.905316 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-99fda83b-30c2-4ea2-a12e-5b4abf22cda1 tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] HTTP exception thrown: Volume c72510d7-eef1-486b-a2a0-46c2281ab522 could not be found. Aug 31 12:59:18.908655 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-99fda83b-30c2-4ea2-a12e-5b4abf22cda1 tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] Request method failure captured: Aug 31 12:59:18.908655 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: request: GET /compute/v2.1/os-volumes/c72510d7-eef1-486b-a2a0-46c2281ab522 HTTP/1.1 Aug 31 12:59:18.908655 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 31 12:59:18.908655 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 31 12:59:18.908655 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Connection: close Aug 31 12:59:18.908655 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 31 12:59:18.908655 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 31 12:59:18.908655 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Host: 10.222.0.58 Aug 31 12:59:18.908655 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 31 12:59:18.908655 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 31 12:59:18.908655 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjD1sR0nqjRX-9KPmX7yDFRfMG5jxAF5jP-EK63L65ZnQ4Zk84dfc7kJoKBlfJfTclKPPakNjesJNsnfFFwBlmcU2LgLmny_qjndBKETlTC8viHWXNpoSgl569mUFGC4Sqj6eQueE1ZsgU3NVDpmVFnJWfsTNSH_OpQ7vdvWsr_jCwhk0 Aug 31 12:59:18.908655 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 31 12:59:18.908655 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 31 12:59:18.908655 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 31 12:59:18.908655 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 31 12:59:18.908655 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 31 12:59:18.908655 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 31 12:59:18.908655 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Id: 2d5fe55c19724f23a98e4b404f18745b Aug 31 12:59:18.908655 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1011580617 Aug 31 12:59:18.908655 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Role: member,reader Aug 31 12:59:18.908655 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Roles: member,reader Aug 31 12:59:18.909886 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2d5fe55c19724f23a98e4b404f18745b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2d5fe55c19724f23a98e4b404f18745b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2d5fe55c19724f23a98e4b404f18745b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2d5fe55c19724f23a98e4b404f18745b"}]}] Aug 31 12:59:18.909886 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1011580617 Aug 31 12:59:18.909886 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant-Id: 2d5fe55c19724f23a98e4b404f18745b Aug 31 12:59:18.909886 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1011580617 Aug 31 12:59:18.909886 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User: tempest-VolumesSnapshotsTestJSON-1011580617-project Aug 31 12:59:18.909886 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 31 12:59:18.909886 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 31 12:59:18.909886 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Id: 2881550924ad4408bccdbd3ee94cd31e Aug 31 12:59:18.909886 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1011580617-project Aug 31 12:59:18.909886 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: method: Aug 31 12:59:18.909886 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: exception: Volume c72510d7-eef1-486b-a2a0-46c2281ab522 could not be found. Aug 31 12:59:18.909886 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: action_args: {'id': 'c72510d7-eef1-486b-a2a0-46c2281ab522'} Aug 31 12:59:18.909886 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:59:18.910561 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:59:18.910561 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 12:59:18.910561 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 12:59:18.910561 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 12:59:18.910561 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 12:59:18.910561 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 12:59:18.910561 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 12:59:18.910561 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 12:59:18.910561 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 12:59:18.910561 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 12:59:18.910561 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 12:59:18.910561 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:59:18.910561 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:59:18.910561 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:59:18.910561 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:59:18.910561 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c72510d7-eef1-486b-a2a0-46c2281ab522 could not be found. (HTTP 404) (Request-ID: req-10685f93-46bc-4725-bf58-a703f565a964) Aug 31 12:59:18.910561 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 12:59:18.910561 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:59:18.910561 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 12:59:18.911522 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:59:18.911522 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 12:59:18.911522 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 12:59:18.911522 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 12:59:18.911522 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 12:59:18.911522 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 12:59:18.911522 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 12:59:18.911522 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 12:59:18.911522 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 12:59:18.911522 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 12:59:18.911522 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 12:59:18.911522 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 12:59:18.911522 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 12:59:18.911522 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 12:59:18.911522 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 12:59:18.911522 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 12:59:18.911522 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 12:59:18.911522 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 12:59:18.911522 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 12:59:18.914730 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:59:18.914730 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:59:18.914730 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:59:18.914730 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:59:18.914730 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c72510d7-eef1-486b-a2a0-46c2281ab522 could not be found. Aug 31 12:59:18.914730 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 12:59:18.914730 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:59:18.914730 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 12:59:18.914730 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:59:18.914730 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:59:18.914730 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:59:18.914730 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:59:18.914730 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:59:18.914730 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 12:59:18.914730 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 12:59:18.914730 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:59:18.914730 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:59:18.914730 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 12:59:18.914730 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:59:18.917541 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c72510d7-eef1-486b-a2a0-46c2281ab522 could not be found. Aug 31 12:59:18.917541 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 12:59:18.917541 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:59:18.917541 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 12:59:18.917541 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:59:18.917541 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:59:18.917541 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:59:18.917541 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:59:18.917541 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:59:18.917541 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c72510d7-eef1-486b-a2a0-46c2281ab522 could not be found. Aug 31 12:59:18.917541 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 12:59:18.919482 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-99fda83b-30c2-4ea2-a12e-5b4abf22cda1 tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] Returning 404 to user: Volume c72510d7-eef1-486b-a2a0-46c2281ab522 could not be found. {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:59:18.920575 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-99fda83b-30c2-4ea2-a12e-5b4abf22cda1 tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/c72510d7-eef1-486b-a2a0-46c2281ab522" status: 404 len: 109 microversion: 2.1 time: 0.061808 Aug 31 12:59:18.921556 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 22/54] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 31 12:59:18 2022] GET /compute/v2.1/os-volumes/c72510d7-eef1-486b-a2a0-46c2281ab522 => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:59:18.931329 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-6b01bf8d-672c-409d-9cdb-ff8aea787e75 tempest-VolumesTestJSON-925372039 tempest-VolumesTestJSON-925372039-project] Calling method '.version_select at 0x7f19517f7a60>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:19.111664 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-3189b6b8-64b9-4006-9d2e-1147c68343fe tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:19.120520 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-3189b6b8-64b9-4006-9d2e-1147c68343fe tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1296 microversion: 2.1 time: 0.316721 Aug 31 12:59:19.124679 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 33/55] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:18 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1296 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:19.149799 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-aa02cc26-0f43-4f05-8e7d-5c351e66f607 tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] Calling method '.version_select at 0x7f19516d38b0>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:19.218684 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-6b01bf8d-672c-409d-9cdb-ff8aea787e75 tempest-VolumesTestJSON-925372039 tempest-VolumesTestJSON-925372039-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.294542 Aug 31 12:59:19.229535 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 23/56] 10.222.0.58 () {58 vars in 1155 bytes} [Wed Aug 31 12:59:18 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:19.237344 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-5ca27bc2-3faf-4c37-944d-97706148005e tempest-VolumesTestJSON-925372039 tempest-VolumesTestJSON-925372039-project] Calling method '.version_select at 0x7f19517895e0>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:19.292448 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.wsgi [None req-aa02cc26-0f43-4f05-8e7d-5c351e66f607 tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] HTTP exception thrown: Volume c72510d7-eef1-486b-a2a0-46c2281ab522 could not be found. Aug 31 12:59:19.294531 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-aa02cc26-0f43-4f05-8e7d-5c351e66f607 tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] Request method failure captured: Aug 31 12:59:19.294531 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: request: DELETE /compute/v2.1/os-volumes/c72510d7-eef1-486b-a2a0-46c2281ab522 HTTP/1.1 Aug 31 12:59:19.294531 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept: application/json Aug 31 12:59:19.294531 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept-Encoding: identity Aug 31 12:59:19.294531 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Connection: close Aug 31 12:59:19.294531 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Length: 0 Aug 31 12:59:19.294531 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Type: application/json Aug 31 12:59:19.294531 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Host: 10.222.0.58 Aug 31 12:59:19.294531 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Openstack-System-Scope: None Aug 31 12:59:19.294531 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: User-Agent: python-urllib3/1.26.12 Aug 31 12:59:19.294531 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Auth-Token: gAAAAABjD1sR0nqjRX-9KPmX7yDFRfMG5jxAF5jP-EK63L65ZnQ4Zk84dfc7kJoKBlfJfTclKPPakNjesJNsnfFFwBlmcU2LgLmny_qjndBKETlTC8viHWXNpoSgl569mUFGC4Sqj6eQueE1ZsgU3NVDpmVFnJWfsTNSH_OpQ7vdvWsr_jCwhk0 Aug 31 12:59:19.294531 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Id: None Aug 31 12:59:19.294531 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Name: None Aug 31 12:59:19.294531 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Identity-Status: Confirmed Aug 31 12:59:19.294531 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Is-Admin-Project: True Aug 31 12:59:19.294531 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Id: default Aug 31 12:59:19.294531 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Name: Default Aug 31 12:59:19.294531 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Id: 2d5fe55c19724f23a98e4b404f18745b Aug 31 12:59:19.294531 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1011580617 Aug 31 12:59:19.294531 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Role: member,reader Aug 31 12:59:19.294531 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Roles: member,reader Aug 31 12:59:19.295886 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2d5fe55c19724f23a98e4b404f18745b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2d5fe55c19724f23a98e4b404f18745b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2d5fe55c19724f23a98e4b404f18745b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2d5fe55c19724f23a98e4b404f18745b"}]}] Aug 31 12:59:19.295886 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1011580617 Aug 31 12:59:19.295886 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Id: 2d5fe55c19724f23a98e4b404f18745b Aug 31 12:59:19.295886 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1011580617 Aug 31 12:59:19.295886 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User: tempest-VolumesSnapshotsTestJSON-1011580617-project Aug 31 12:59:19.295886 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Id: default Aug 31 12:59:19.295886 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Name: Default Aug 31 12:59:19.295886 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Id: 2881550924ad4408bccdbd3ee94cd31e Aug 31 12:59:19.295886 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1011580617-project Aug 31 12:59:19.295886 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: method: Aug 31 12:59:19.295886 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: exception: Volume c72510d7-eef1-486b-a2a0-46c2281ab522 could not be found. Aug 31 12:59:19.295886 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: action_args: {'id': 'c72510d7-eef1-486b-a2a0-46c2281ab522'} Aug 31 12:59:19.295886 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:59:19.296763 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:59:19.296763 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 12:59:19.296763 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 12:59:19.296763 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 12:59:19.296763 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 12:59:19.296763 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 12:59:19.296763 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 12:59:19.296763 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 12:59:19.296763 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 12:59:19.296763 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 12:59:19.296763 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 12:59:19.296763 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:59:19.296763 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:59:19.296763 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:59:19.296763 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:59:19.296763 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c72510d7-eef1-486b-a2a0-46c2281ab522 could not be found. (HTTP 404) (Request-ID: req-9bf93164-41d1-42b3-b62a-242361fa7f59) Aug 31 12:59:19.296763 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:59:19.296763 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:59:19.296763 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:59:19.297988 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:59:19.297988 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 12:59:19.297988 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 12:59:19.297988 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 12:59:19.297988 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 12:59:19.297988 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 12:59:19.297988 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 12:59:19.297988 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 12:59:19.297988 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 12:59:19.297988 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 12:59:19.297988 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 12:59:19.297988 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 12:59:19.297988 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 12:59:19.297988 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 12:59:19.297988 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 12:59:19.297988 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 12:59:19.297988 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 12:59:19.297988 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 12:59:19.297988 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 12:59:19.299186 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:59:19.299186 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:59:19.299186 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:59:19.299186 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:59:19.299186 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c72510d7-eef1-486b-a2a0-46c2281ab522 could not be found. Aug 31 12:59:19.299186 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:59:19.299186 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:59:19.299186 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:59:19.299186 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:59:19.299186 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:59:19.299186 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:59:19.299186 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:59:19.299186 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:59:19.299186 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 12:59:19.299186 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 12:59:19.299186 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:59:19.299186 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:59:19.299186 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 12:59:19.299186 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:59:19.300270 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c72510d7-eef1-486b-a2a0-46c2281ab522 could not be found. Aug 31 12:59:19.300270 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:59:19.300270 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:59:19.300270 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:59:19.300270 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:59:19.300270 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:59:19.300270 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:59:19.300270 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:59:19.300270 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:59:19.300270 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c72510d7-eef1-486b-a2a0-46c2281ab522 could not be found. Aug 31 12:59:19.300270 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:59:19.300270 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-aa02cc26-0f43-4f05-8e7d-5c351e66f607 tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] Returning 404 to user: Volume c72510d7-eef1-486b-a2a0-46c2281ab522 could not be found. {{(pid=120704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:59:19.300270 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-aa02cc26-0f43-4f05-8e7d-5c351e66f607 tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/c72510d7-eef1-486b-a2a0-46c2281ab522" status: 404 len: 109 microversion: 2.1 time: 0.170236 Aug 31 12:59:19.300270 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 34/57] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 31 12:59:19 2022] DELETE /compute/v2.1/os-volumes/c72510d7-eef1-486b-a2a0-46c2281ab522 => generated 109 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:59:19.305157 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-56619010-9aeb-4583-8446-5fbe4ea19aca tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] Calling method '.version_select at 0x7f1951763c10>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:19.437496 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.wsgi [None req-56619010-9aeb-4583-8446-5fbe4ea19aca tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] HTTP exception thrown: Volume c72510d7-eef1-486b-a2a0-46c2281ab522 could not be found. Aug 31 12:59:19.439610 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-56619010-9aeb-4583-8446-5fbe4ea19aca tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] Request method failure captured: Aug 31 12:59:19.439610 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: request: GET /compute/v2.1/os-volumes/c72510d7-eef1-486b-a2a0-46c2281ab522 HTTP/1.1 Aug 31 12:59:19.439610 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept: application/json Aug 31 12:59:19.439610 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept-Encoding: identity Aug 31 12:59:19.439610 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Connection: close Aug 31 12:59:19.439610 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Length: 0 Aug 31 12:59:19.439610 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Type: application/json Aug 31 12:59:19.439610 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Host: 10.222.0.58 Aug 31 12:59:19.439610 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Openstack-System-Scope: None Aug 31 12:59:19.439610 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: User-Agent: python-urllib3/1.26.12 Aug 31 12:59:19.439610 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Auth-Token: gAAAAABjD1sR0nqjRX-9KPmX7yDFRfMG5jxAF5jP-EK63L65ZnQ4Zk84dfc7kJoKBlfJfTclKPPakNjesJNsnfFFwBlmcU2LgLmny_qjndBKETlTC8viHWXNpoSgl569mUFGC4Sqj6eQueE1ZsgU3NVDpmVFnJWfsTNSH_OpQ7vdvWsr_jCwhk0 Aug 31 12:59:19.439610 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Id: None Aug 31 12:59:19.439610 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Name: None Aug 31 12:59:19.439610 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Identity-Status: Confirmed Aug 31 12:59:19.439610 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Is-Admin-Project: True Aug 31 12:59:19.439610 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Id: default Aug 31 12:59:19.439610 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Name: Default Aug 31 12:59:19.439610 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Id: 2d5fe55c19724f23a98e4b404f18745b Aug 31 12:59:19.439610 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1011580617 Aug 31 12:59:19.439610 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Role: member,reader Aug 31 12:59:19.439610 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Roles: member,reader Aug 31 12:59:19.441041 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2d5fe55c19724f23a98e4b404f18745b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2d5fe55c19724f23a98e4b404f18745b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2d5fe55c19724f23a98e4b404f18745b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2d5fe55c19724f23a98e4b404f18745b"}]}] Aug 31 12:59:19.441041 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1011580617 Aug 31 12:59:19.441041 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Id: 2d5fe55c19724f23a98e4b404f18745b Aug 31 12:59:19.441041 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1011580617 Aug 31 12:59:19.441041 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User: tempest-VolumesSnapshotsTestJSON-1011580617-project Aug 31 12:59:19.441041 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Id: default Aug 31 12:59:19.441041 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Name: Default Aug 31 12:59:19.441041 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Id: 2881550924ad4408bccdbd3ee94cd31e Aug 31 12:59:19.441041 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1011580617-project Aug 31 12:59:19.441041 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: method: Aug 31 12:59:19.441041 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: exception: Volume c72510d7-eef1-486b-a2a0-46c2281ab522 could not be found. Aug 31 12:59:19.441041 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: action_args: {'id': 'c72510d7-eef1-486b-a2a0-46c2281ab522'} Aug 31 12:59:19.441041 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:59:19.441698 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:59:19.441698 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 12:59:19.441698 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 12:59:19.441698 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 12:59:19.441698 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 12:59:19.441698 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 12:59:19.441698 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 12:59:19.441698 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 12:59:19.441698 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 12:59:19.441698 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 12:59:19.441698 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 12:59:19.441698 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:59:19.441698 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:59:19.441698 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:59:19.441698 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:59:19.441698 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c72510d7-eef1-486b-a2a0-46c2281ab522 could not be found. (HTTP 404) (Request-ID: req-602211e8-01dc-48b8-8a37-5e37a4686615) Aug 31 12:59:19.441698 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:59:19.441698 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:59:19.441698 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:59:19.443049 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:59:19.443049 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 12:59:19.443049 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 12:59:19.443049 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 12:59:19.443049 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 12:59:19.443049 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 12:59:19.443049 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 12:59:19.443049 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 12:59:19.443049 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 12:59:19.443049 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 12:59:19.443049 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 12:59:19.443049 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 12:59:19.443049 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 12:59:19.443049 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 12:59:19.443049 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 12:59:19.443049 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 12:59:19.443049 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 12:59:19.443049 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 12:59:19.443049 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 12:59:19.445439 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:59:19.445439 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:59:19.445439 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:59:19.445439 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:59:19.445439 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c72510d7-eef1-486b-a2a0-46c2281ab522 could not be found. Aug 31 12:59:19.445439 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:59:19.445439 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:59:19.445439 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:59:19.445439 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:59:19.445439 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:59:19.445439 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:59:19.445439 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:59:19.445439 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:59:19.445439 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 12:59:19.445439 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 12:59:19.445439 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:59:19.445439 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:59:19.445439 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 12:59:19.445439 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:59:19.447683 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c72510d7-eef1-486b-a2a0-46c2281ab522 could not be found. Aug 31 12:59:19.447683 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:59:19.447683 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:59:19.447683 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:59:19.447683 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:59:19.447683 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:59:19.447683 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:59:19.447683 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:59:19.447683 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:59:19.447683 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c72510d7-eef1-486b-a2a0-46c2281ab522 could not be found. Aug 31 12:59:19.447683 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:59:19.447683 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-56619010-9aeb-4583-8446-5fbe4ea19aca tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] Returning 404 to user: Volume c72510d7-eef1-486b-a2a0-46c2281ab522 could not be found. {{(pid=120704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:59:19.447683 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-56619010-9aeb-4583-8446-5fbe4ea19aca tempest-VolumesSnapshotsTestJSON-1011580617 tempest-VolumesSnapshotsTestJSON-1011580617-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/c72510d7-eef1-486b-a2a0-46c2281ab522" status: 404 len: 109 microversion: 2.1 time: 0.140260 Aug 31 12:59:19.447683 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 35/58] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 31 12:59:19 2022] GET /compute/v2.1/os-volumes/c72510d7-eef1-486b-a2a0-46c2281ab522 => generated 109 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:59:19.546974 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-da4cbc55-89f8-4cf6-9013-cef11459b9c6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:19.547910 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-da4cbc55-89f8-4cf6-9013-cef11459b9c6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:19.564276 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-da4cbc55-89f8-4cf6-9013-cef11459b9c6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:19.565030 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-da4cbc55-89f8-4cf6-9013-cef11459b9c6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:19.570330 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-da4cbc55-89f8-4cf6-9013-cef11459b9c6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:19.573416 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-da4cbc55-89f8-4cf6-9013-cef11459b9c6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:19.576779 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-da4cbc55-89f8-4cf6-9013-cef11459b9c6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:19.582709 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-da4cbc55-89f8-4cf6-9013-cef11459b9c6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:19.585973 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-5ca27bc2-3faf-4c37-944d-97706148005e tempest-VolumesTestJSON-925372039 tempest-VolumesTestJSON-925372039-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.354456 Aug 31 12:59:19.587533 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 24/59] 10.222.0.58 () {58 vars in 1188 bytes} [Wed Aug 31 12:59:19 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:59:19.602236 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-c127c1a6-b3e8-4fa6-b68f-f483f7ebcaf7 tempest-VolumesTestJSON-925372039 tempest-VolumesTestJSON-925372039-project] Calling method '.version_select at 0x7f1951781ee0>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:19.974924 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-c127c1a6-b3e8-4fa6-b68f-f483f7ebcaf7 tempest-VolumesTestJSON-925372039 tempest-VolumesTestJSON-925372039-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.377724 Aug 31 12:59:19.975874 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 25/60] 10.222.0.58 () {58 vars in 1155 bytes} [Wed Aug 31 12:59:19 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:19.986821 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-da4cbc55-89f8-4cf6-9013-cef11459b9c6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:20.008112 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-c97ce9f3-06b5-4709-a2d3-95c8c79e5065 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:20.008844 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-c97ce9f3-06b5-4709-a2d3-95c8c79e5065 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:20.010829 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-da4cbc55-89f8-4cf6-9013-cef11459b9c6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1279 microversion: 2.1 time: 0.454019 Aug 31 12:59:20.027763 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c97ce9f3-06b5-4709-a2d3-95c8c79e5065 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:20.027763 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c97ce9f3-06b5-4709-a2d3-95c8c79e5065 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:20.027763 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c97ce9f3-06b5-4709-a2d3-95c8c79e5065 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:20.029423 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c97ce9f3-06b5-4709-a2d3-95c8c79e5065 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:20.029903 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c97ce9f3-06b5-4709-a2d3-95c8c79e5065 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:20.034959 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c97ce9f3-06b5-4709-a2d3-95c8c79e5065 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:20.035574 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 36/61] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:19 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1279 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:20.156346 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-83865700-1808-4211-afe5-c84df32265a9 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:20.157337 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-83865700-1808-4211-afe5-c84df32265a9 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:20.175488 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-83865700-1808-4211-afe5-c84df32265a9 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:20.176894 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-83865700-1808-4211-afe5-c84df32265a9 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:20.183104 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-83865700-1808-4211-afe5-c84df32265a9 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:20.185111 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-83865700-1808-4211-afe5-c84df32265a9 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:20.185809 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-83865700-1808-4211-afe5-c84df32265a9 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:20.188397 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-83865700-1808-4211-afe5-c84df32265a9 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:20.299918 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-c97ce9f3-06b5-4709-a2d3-95c8c79e5065 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63adaf56e417cba603f908a8e451c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0eff3111a5847a68620fce8060df208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:20.315760 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-c97ce9f3-06b5-4709-a2d3-95c8c79e5065 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 200 len: 1273 microversion: 2.1 time: 0.337197 Aug 31 12:59:20.323298 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 26/62] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:19 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 1273 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:20.426684 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-83865700-1808-4211-afe5-c84df32265a9 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:20.465694 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-83865700-1808-4211-afe5-c84df32265a9 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1296 microversion: 2.1 time: 0.317239 Aug 31 12:59:20.475804 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 37/63] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:20 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1296 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:21.057007 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-c8f5963a-6a4d-4ddc-8d2e-308ea3ffceab tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:21.058285 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-c8f5963a-6a4d-4ddc-8d2e-308ea3ffceab tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:21.064761 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c8f5963a-6a4d-4ddc-8d2e-308ea3ffceab tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:21.065545 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c8f5963a-6a4d-4ddc-8d2e-308ea3ffceab tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:21.066307 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c8f5963a-6a4d-4ddc-8d2e-308ea3ffceab tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:21.067281 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c8f5963a-6a4d-4ddc-8d2e-308ea3ffceab tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:21.068026 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c8f5963a-6a4d-4ddc-8d2e-308ea3ffceab tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:21.068703 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c8f5963a-6a4d-4ddc-8d2e-308ea3ffceab tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:21.344291 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-a0df34d5-2c5f-4bdf-8d0d-6b2adcd61f20 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:21.345038 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-a0df34d5-2c5f-4bdf-8d0d-6b2adcd61f20 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:21.366068 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a0df34d5-2c5f-4bdf-8d0d-6b2adcd61f20 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:21.368733 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a0df34d5-2c5f-4bdf-8d0d-6b2adcd61f20 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:21.371439 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a0df34d5-2c5f-4bdf-8d0d-6b2adcd61f20 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:21.378258 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a0df34d5-2c5f-4bdf-8d0d-6b2adcd61f20 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:21.380872 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a0df34d5-2c5f-4bdf-8d0d-6b2adcd61f20 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:21.384649 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a0df34d5-2c5f-4bdf-8d0d-6b2adcd61f20 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:22.441475 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell0:SELECT=4 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:59:22.531540 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-a0df34d5-2c5f-4bdf-8d0d-6b2adcd61f20 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63adaf56e417cba603f908a8e451c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0eff3111a5847a68620fce8060df208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:22.543428 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-a0df34d5-2c5f-4bdf-8d0d-6b2adcd61f20 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 200 len: 1315 microversion: 2.1 time: 1.204171 Aug 31 12:59:22.555934 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 38/64] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:21 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 1315 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:59:22.577043 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-ee51e8c7-e51c-4608-adcd-cb67efd7f1f6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:22.590615 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-ee51e8c7-e51c-4608-adcd-cb67efd7f1f6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:22.619007 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ee51e8c7-e51c-4608-adcd-cb67efd7f1f6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:22.622843 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ee51e8c7-e51c-4608-adcd-cb67efd7f1f6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:22.624943 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ee51e8c7-e51c-4608-adcd-cb67efd7f1f6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:22.630247 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ee51e8c7-e51c-4608-adcd-cb67efd7f1f6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:22.631056 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ee51e8c7-e51c-4608-adcd-cb67efd7f1f6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:22.633009 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ee51e8c7-e51c-4608-adcd-cb67efd7f1f6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:22.843523 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-c8f5963a-6a4d-4ddc-8d2e-308ea3ffceab tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:22.864780 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-c8f5963a-6a4d-4ddc-8d2e-308ea3ffceab tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1321 microversion: 2.1 time: 1.818117 Aug 31 12:59:22.867311 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 27/65] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:21 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1321 bytes in 1822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:23.037396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell0:SELECT=20 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:59:23.578248 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-5322da35-0657-4af2-a2d4-3fc18651241e tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:23.578883 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-5322da35-0657-4af2-a2d4-3fc18651241e tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:23.599570 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5322da35-0657-4af2-a2d4-3fc18651241e tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:23.602157 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5322da35-0657-4af2-a2d4-3fc18651241e tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:23.602648 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5322da35-0657-4af2-a2d4-3fc18651241e tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:23.608162 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5322da35-0657-4af2-a2d4-3fc18651241e tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:23.610166 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5322da35-0657-4af2-a2d4-3fc18651241e tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:23.612881 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5322da35-0657-4af2-a2d4-3fc18651241e tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:25.683411 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-5322da35-0657-4af2-a2d4-3fc18651241e tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63adaf56e417cba603f908a8e451c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0eff3111a5847a68620fce8060df208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:25.686900 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-ee51e8c7-e51c-4608-adcd-cb67efd7f1f6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:25.698022 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-ee51e8c7-e51c-4608-adcd-cb67efd7f1f6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1363 microversion: 2.1 time: 3.137485 Aug 31 12:59:25.699485 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-5322da35-0657-4af2-a2d4-3fc18651241e tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 200 len: 1315 microversion: 2.1 time: 2.120057 Aug 31 12:59:25.708633 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 39/66] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:22 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1363 bytes in 3152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:25.714466 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 28/67] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:23 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 1315 bytes in 2141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:25.726203 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-51183c46-3e93-4b71-be95-bcde024509d9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:25.729621 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-51183c46-3e93-4b71-be95-bcde024509d9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:25.741254 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-51183c46-3e93-4b71-be95-bcde024509d9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:25.744087 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-51183c46-3e93-4b71-be95-bcde024509d9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:25.746979 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-51183c46-3e93-4b71-be95-bcde024509d9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:25.750344 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-51183c46-3e93-4b71-be95-bcde024509d9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:25.753157 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-51183c46-3e93-4b71-be95-bcde024509d9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:25.754188 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-51183c46-3e93-4b71-be95-bcde024509d9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:25.830225 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=4 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:59:26.018602 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=16 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:59:26.580056 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-fa0378a3-77a1-4508-8818-b7fa8ae758e4 tempest-VolumesGetTestJSON-2018176503 tempest-VolumesGetTestJSON-2018176503-project] Action: 'create', calling method: .version_select at 0x7f195177d550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-393248402", "metadata": {"Type": "work"}}} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:59:27.026639 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-51183c46-3e93-4b71-be95-bcde024509d9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:27.036219 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-51183c46-3e93-4b71-be95-bcde024509d9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1321 microversion: 2.1 time: 1.319399 Aug 31 12:59:27.047580 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 29/68] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:25 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1321 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:27.053956 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-ca7f849b-295b-4a18-89ca-880a48ae2b17 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:27.070757 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-ca7f849b-295b-4a18-89ca-880a48ae2b17 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:27.093015 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ca7f849b-295b-4a18-89ca-880a48ae2b17 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:27.096594 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ca7f849b-295b-4a18-89ca-880a48ae2b17 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:27.101722 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ca7f849b-295b-4a18-89ca-880a48ae2b17 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:27.107395 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ca7f849b-295b-4a18-89ca-880a48ae2b17 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:27.108264 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ca7f849b-295b-4a18-89ca-880a48ae2b17 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:27.108717 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ca7f849b-295b-4a18-89ca-880a48ae2b17 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:27.629661 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-fa0378a3-77a1-4508-8818-b7fa8ae758e4 tempest-VolumesGetTestJSON-2018176503 tempest-VolumesGetTestJSON-2018176503-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.261164 Aug 31 12:59:27.640421 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 40/69] 10.222.0.58 () {60 vars in 1156 bytes} [Wed Aug 31 12:59:26 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1273 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 31 12:59:27.646131 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-18f7e938-377f-4b21-8d53-2e3465445bc0 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:27.647201 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-18f7e938-377f-4b21-8d53-2e3465445bc0 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:27.663470 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-18f7e938-377f-4b21-8d53-2e3465445bc0 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:27.665802 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-18f7e938-377f-4b21-8d53-2e3465445bc0 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:27.666497 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-18f7e938-377f-4b21-8d53-2e3465445bc0 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:27.667480 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-18f7e938-377f-4b21-8d53-2e3465445bc0 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:27.668197 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-18f7e938-377f-4b21-8d53-2e3465445bc0 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:27.668830 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-18f7e938-377f-4b21-8d53-2e3465445bc0 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:28.204324 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-ca7f849b-295b-4a18-89ca-880a48ae2b17 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63adaf56e417cba603f908a8e451c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0eff3111a5847a68620fce8060df208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:28.216584 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-ca7f849b-295b-4a18-89ca-880a48ae2b17 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 200 len: 1315 microversion: 2.1 time: 1.166586 Aug 31 12:59:28.217737 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 30/70] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:27 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 1315 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:28.222509 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-18f7e938-377f-4b21-8d53-2e3465445bc0 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:28.235727 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-18f7e938-377f-4b21-8d53-2e3465445bc0 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1363 microversion: 2.1 time: 0.593490 Aug 31 12:59:28.237026 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 41/71] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:27 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1363 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:28.255693 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-4969f5dc-64a8-4f33-991e-074784efb3c2 tempest-VolumesGetTestJSON-2018176503 tempest-VolumesGetTestJSON-2018176503-project] Calling method '.version_select at 0x7f19517e4d30>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:28.330713 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-4969f5dc-64a8-4f33-991e-074784efb3c2 tempest-VolumesGetTestJSON-2018176503 tempest-VolumesGetTestJSON-2018176503-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/4984f689-3fe7-4916-a36d-2faa739eea30" status: 200 len: 352 microversion: 2.1 time: 0.091954 Aug 31 12:59:28.331758 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 42/72] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 31 12:59:28 2022] GET /compute/v2.1/os-volumes/4984f689-3fe7-4916-a36d-2faa739eea30 => generated 352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:59:28.370369 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-668d78bf-3223-454f-932d-a16f2ebe1553 req-16199999-a731-4e4f-b1ef-bace4c12a810 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f97b98c1-e7be-4c90-8c65-715135db482b", "tag": "02f6e7e8-3148-4cb2-917c-2e387bedf92c"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:59:28.397226 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-668d78bf-3223-454f-932d-a16f2ebe1553 req-16199999-a731-4e4f-b1ef-bace4c12a810 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:28.398239 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-668d78bf-3223-454f-932d-a16f2ebe1553 req-16199999-a731-4e4f-b1ef-bace4c12a810 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:28.399051 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-668d78bf-3223-454f-932d-a16f2ebe1553 req-16199999-a731-4e4f-b1ef-bace4c12a810 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:28.429932 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-668d78bf-3223-454f-932d-a16f2ebe1553 req-16199999-a731-4e4f-b1ef-bace4c12a810 service nova] Creating event network-changed:02f6e7e8-3148-4cb2-917c-2e387bedf92c for instance f97b98c1-e7be-4c90-8c65-715135db482b on hv-cinder-85442 Aug 31 12:59:28.430865 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-668d78bf-3223-454f-932d-a16f2ebe1553 req-16199999-a731-4e4f-b1ef-bace4c12a810 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120705) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 12:59:28.431459 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-668d78bf-3223-454f-932d-a16f2ebe1553 req-16199999-a731-4e4f-b1ef-bace4c12a810 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120705) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 12:59:28.434705 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c483c438-7f05-44d2-9df5-6dd4789afe64 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:28.435294 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c483c438-7f05-44d2-9df5-6dd4789afe64 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:28.437169 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c483c438-7f05-44d2-9df5-6dd4789afe64 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:28.438022 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c483c438-7f05-44d2-9df5-6dd4789afe64 None None] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:28.438575 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c483c438-7f05-44d2-9df5-6dd4789afe64 None None] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:28.441449 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c483c438-7f05-44d2-9df5-6dd4789afe64 None None] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:28.464448 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.compute.rpcapi [None req-c483c438-7f05-44d2-9df5-6dd4789afe64 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 31 12:59:28.464747 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-5f16b338-3715-421d-97a9-ce01d32359c4 req-b5f24634-928c-4812-8a1a-e18ccf827240 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48f08cc0-15cb-4884-960b-a96396a0d4bf", "tag": "d7daad8a-fae2-4a08-ba82-bc48fa334e9e"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:59:28.465797 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c483c438-7f05-44d2-9df5-6dd4789afe64 None None] Releasing lock "compute-rpcapi-router" {{(pid=120705) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 12:59:28.470615 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=7 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:59:28.496480 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-c483c438-7f05-44d2-9df5-6dd4789afe64 None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.276726 Aug 31 12:59:28.496888 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 31/73] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 12:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:59:28.513791 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-23648981-1446-4e1e-ade5-790ea82671c9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:28.514558 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-23648981-1446-4e1e-ade5-790ea82671c9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:28.517502 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-5f16b338-3715-421d-97a9-ce01d32359c4 req-b5f24634-928c-4812-8a1a-e18ccf827240 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:28.520158 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-5f16b338-3715-421d-97a9-ce01d32359c4 req-b5f24634-928c-4812-8a1a-e18ccf827240 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:28.522474 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-5f16b338-3715-421d-97a9-ce01d32359c4 req-b5f24634-928c-4812-8a1a-e18ccf827240 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:28.532690 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-23648981-1446-4e1e-ade5-790ea82671c9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:28.533602 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-23648981-1446-4e1e-ade5-790ea82671c9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:28.534242 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-23648981-1446-4e1e-ade5-790ea82671c9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:28.535207 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-23648981-1446-4e1e-ade5-790ea82671c9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:28.535893 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-23648981-1446-4e1e-ade5-790ea82671c9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:28.536514 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-23648981-1446-4e1e-ade5-790ea82671c9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:28.581922 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-5f16b338-3715-421d-97a9-ce01d32359c4 req-b5f24634-928c-4812-8a1a-e18ccf827240 service nova] Creating event network-changed:d7daad8a-fae2-4a08-ba82-bc48fa334e9e for instance 48f08cc0-15cb-4884-960b-a96396a0d4bf on hv-cinder-85442 Aug 31 12:59:28.588936 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-5f16b338-3715-421d-97a9-ce01d32359c4 req-b5f24634-928c-4812-8a1a-e18ccf827240 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120704) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 12:59:28.591428 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-5f16b338-3715-421d-97a9-ce01d32359c4 req-b5f24634-928c-4812-8a1a-e18ccf827240 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120704) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 12:59:28.597257 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-107f03f4-d4f5-4e4d-9fb5-9da9590c4700 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:28.598231 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-107f03f4-d4f5-4e4d-9fb5-9da9590c4700 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:28.598892 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-107f03f4-d4f5-4e4d-9fb5-9da9590c4700 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:28.599896 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-107f03f4-d4f5-4e4d-9fb5-9da9590c4700 None None] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:28.600845 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-107f03f4-d4f5-4e4d-9fb5-9da9590c4700 None None] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:28.601589 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-107f03f4-d4f5-4e4d-9fb5-9da9590c4700 None None] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:28.612713 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.compute.rpcapi [None req-107f03f4-d4f5-4e4d-9fb5-9da9590c4700 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 31 12:59:28.614002 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-107f03f4-d4f5-4e4d-9fb5-9da9590c4700 None None] Releasing lock "compute-rpcapi-router" {{(pid=120704) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 12:59:28.637764 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-107f03f4-d4f5-4e4d-9fb5-9da9590c4700 None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.303450 Aug 31 12:59:28.642196 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 43/74] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 12:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:59:28.907362 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-23648981-1446-4e1e-ade5-790ea82671c9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:28.916673 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-23648981-1446-4e1e-ade5-790ea82671c9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1321 microversion: 2.1 time: 0.418257 Aug 31 12:59:28.917252 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 32/75] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:28 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1321 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:29.241677 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-bd1a8122-bdff-434f-817b-ab714d03f2e7 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:29.243608 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-bd1a8122-bdff-434f-817b-ab714d03f2e7 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:29.252603 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bd1a8122-bdff-434f-817b-ab714d03f2e7 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:29.253495 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bd1a8122-bdff-434f-817b-ab714d03f2e7 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:29.254128 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bd1a8122-bdff-434f-817b-ab714d03f2e7 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:29.255278 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bd1a8122-bdff-434f-817b-ab714d03f2e7 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:29.256056 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bd1a8122-bdff-434f-817b-ab714d03f2e7 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:29.256734 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bd1a8122-bdff-434f-817b-ab714d03f2e7 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:29.261441 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-60251640-8289-4826-9410-5987e3e08199 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:29.262115 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-60251640-8289-4826-9410-5987e3e08199 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:29.271551 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-60251640-8289-4826-9410-5987e3e08199 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:29.279481 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-60251640-8289-4826-9410-5987e3e08199 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:29.281746 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-60251640-8289-4826-9410-5987e3e08199 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:29.282690 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-60251640-8289-4826-9410-5987e3e08199 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:29.284499 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-60251640-8289-4826-9410-5987e3e08199 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:29.285119 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-60251640-8289-4826-9410-5987e3e08199 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:29.485909 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-bd1a8122-bdff-434f-817b-ab714d03f2e7 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63adaf56e417cba603f908a8e451c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0eff3111a5847a68620fce8060df208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:29.495425 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-bd1a8122-bdff-434f-817b-ab714d03f2e7 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 200 len: 1315 microversion: 2.1 time: 0.260152 Aug 31 12:59:29.505646 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 44/76] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:29 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:29.529291 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-86d2928a-1faa-475a-b5f1-ec2402fbf61e tempest-VolumesGetTestJSON-2018176503 tempest-VolumesGetTestJSON-2018176503-project] Calling method '.version_select at 0x7f19517633a0>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:29.616330 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-60251640-8289-4826-9410-5987e3e08199 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:29.626684 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-60251640-8289-4826-9410-5987e3e08199 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1363 microversion: 2.1 time: 0.370333 Aug 31 12:59:29.638740 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 33/77] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:29 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1363 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:29.658499 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-86d2928a-1faa-475a-b5f1-ec2402fbf61e tempest-VolumesGetTestJSON-2018176503 tempest-VolumesGetTestJSON-2018176503-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/4984f689-3fe7-4916-a36d-2faa739eea30" status: 200 len: 353 microversion: 2.1 time: 0.160817 Aug 31 12:59:29.659140 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 45/78] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 31 12:59:29 2022] GET /compute/v2.1/os-volumes/4984f689-3fe7-4916-a36d-2faa739eea30 => generated 353 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:59:29.675128 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-1dee7caa-3f57-4798-9846-776e1c82144f tempest-VolumesGetTestJSON-2018176503 tempest-VolumesGetTestJSON-2018176503-project] Calling method '.version_select at 0x7f1951789af0>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:29.760975 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-1dee7caa-3f57-4798-9846-776e1c82144f tempest-VolumesGetTestJSON-2018176503 tempest-VolumesGetTestJSON-2018176503-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/4984f689-3fe7-4916-a36d-2faa739eea30" status: 200 len: 353 microversion: 2.1 time: 0.089745 Aug 31 12:59:29.762716 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 34/79] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 31 12:59:29 2022] GET /compute/v2.1/os-volumes/4984f689-3fe7-4916-a36d-2faa739eea30 => generated 353 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:59:29.781345 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-c2d3b144-ab9f-4f5c-8f6c-ba4646fedf26 tempest-VolumesGetTestJSON-2018176503 tempest-VolumesGetTestJSON-2018176503-project] Calling method '.version_select at 0x7f19516d35e0>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:29.897783 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-c2d3b144-ab9f-4f5c-8f6c-ba4646fedf26 tempest-VolumesGetTestJSON-2018176503 tempest-VolumesGetTestJSON-2018176503-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/4984f689-3fe7-4916-a36d-2faa739eea30" status: 202 len: 0 microversion: 2.1 time: 0.121195 Aug 31 12:59:29.898348 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 46/80] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 31 12:59:29 2022] DELETE /compute/v2.1/os-volumes/4984f689-3fe7-4916-a36d-2faa739eea30 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:59:29.907783 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-6532f12c-f42e-4b43-8432-744bfd005560 tempest-VolumesGetTestJSON-2018176503 tempest-VolumesGetTestJSON-2018176503-project] Calling method '.version_select at 0x7f19517a0b80>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:29.945364 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-32bf755f-b4e3-4395-9d15-b78c48980ae6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:29.948011 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-32bf755f-b4e3-4395-9d15-b78c48980ae6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:29.973994 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-32bf755f-b4e3-4395-9d15-b78c48980ae6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:29.974748 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-32bf755f-b4e3-4395-9d15-b78c48980ae6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:29.975359 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-32bf755f-b4e3-4395-9d15-b78c48980ae6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:29.979025 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-32bf755f-b4e3-4395-9d15-b78c48980ae6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:29.979738 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-32bf755f-b4e3-4395-9d15-b78c48980ae6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:29.983800 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-32bf755f-b4e3-4395-9d15-b78c48980ae6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:30.058103 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-6532f12c-f42e-4b43-8432-744bfd005560 tempest-VolumesGetTestJSON-2018176503 tempest-VolumesGetTestJSON-2018176503-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/4984f689-3fe7-4916-a36d-2faa739eea30" status: 200 len: 352 microversion: 2.1 time: 0.155380 Aug 31 12:59:30.058811 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 35/81] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 31 12:59:29 2022] GET /compute/v2.1/os-volumes/4984f689-3fe7-4916-a36d-2faa739eea30 => generated 352 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:59:30.390795 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-32bf755f-b4e3-4395-9d15-b78c48980ae6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:30.400278 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-32bf755f-b4e3-4395-9d15-b78c48980ae6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1321 microversion: 2.1 time: 0.464661 Aug 31 12:59:30.405095 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 47/82] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:29 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1321 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:30.520097 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-c4a24b48-7f4a-4e93-922e-a8f8e4d3968b req-e5c86c79-15ad-4f7f-8568-ddc453860694 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de7a8eee-34d7-45c9-bbc0-5b9f954776e7", "tag": "f29a1e36-6b6c-465b-971e-9130133909df"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:59:30.520662 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-f12d1258-098d-468a-b465-8c740c499007 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:30.520856 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-f12d1258-098d-468a-b465-8c740c499007 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:30.532297 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f12d1258-098d-468a-b465-8c740c499007 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:30.534028 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f12d1258-098d-468a-b465-8c740c499007 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:30.537089 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f12d1258-098d-468a-b465-8c740c499007 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:30.539955 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f12d1258-098d-468a-b465-8c740c499007 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:30.540967 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f12d1258-098d-468a-b465-8c740c499007 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:30.542720 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f12d1258-098d-468a-b465-8c740c499007 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:30.549114 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-c4a24b48-7f4a-4e93-922e-a8f8e4d3968b req-e5c86c79-15ad-4f7f-8568-ddc453860694 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:30.549683 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-c4a24b48-7f4a-4e93-922e-a8f8e4d3968b req-e5c86c79-15ad-4f7f-8568-ddc453860694 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:30.550156 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-c4a24b48-7f4a-4e93-922e-a8f8e4d3968b req-e5c86c79-15ad-4f7f-8568-ddc453860694 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:30.593392 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-c4a24b48-7f4a-4e93-922e-a8f8e4d3968b req-e5c86c79-15ad-4f7f-8568-ddc453860694 service nova] Creating event network-changed:f29a1e36-6b6c-465b-971e-9130133909df for instance de7a8eee-34d7-45c9-bbc0-5b9f954776e7 on hv-cinder-85442 Aug 31 12:59:30.605574 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-c4a24b48-7f4a-4e93-922e-a8f8e4d3968b req-e5c86c79-15ad-4f7f-8568-ddc453860694 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085021 Aug 31 12:59:30.605574 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 36/83] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 12:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:59:30.657598 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-75bae18c-7e84-4ff8-bef7-b96ae723e2cd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:30.660094 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-75bae18c-7e84-4ff8-bef7-b96ae723e2cd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:30.670474 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-75bae18c-7e84-4ff8-bef7-b96ae723e2cd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:30.671118 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-75bae18c-7e84-4ff8-bef7-b96ae723e2cd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:30.671989 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-75bae18c-7e84-4ff8-bef7-b96ae723e2cd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:30.673056 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-75bae18c-7e84-4ff8-bef7-b96ae723e2cd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:30.673660 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-75bae18c-7e84-4ff8-bef7-b96ae723e2cd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:30.674243 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-75bae18c-7e84-4ff8-bef7-b96ae723e2cd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:30.745781 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-f12d1258-098d-468a-b465-8c740c499007 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63adaf56e417cba603f908a8e451c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0eff3111a5847a68620fce8060df208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:30.759492 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-f12d1258-098d-468a-b465-8c740c499007 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 200 len: 1315 microversion: 2.1 time: 0.242796 Aug 31 12:59:30.760393 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 48/84] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:30 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:30.778057 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-3b96861d-8a04-4ed6-b7c3-fa141a71aa28 req-cd6103ed-042b-47df-81e9-ae8b1dd8803a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "447f6c66-64aa-4e88-a317-27c64b4d82ea", "tag": "e224a14c-9b7e-409c-aa96-28fe27b7f502"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:59:30.801736 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-3b96861d-8a04-4ed6-b7c3-fa141a71aa28 req-cd6103ed-042b-47df-81e9-ae8b1dd8803a service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:30.810549 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-3b96861d-8a04-4ed6-b7c3-fa141a71aa28 req-cd6103ed-042b-47df-81e9-ae8b1dd8803a service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:30.812613 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-3b96861d-8a04-4ed6-b7c3-fa141a71aa28 req-cd6103ed-042b-47df-81e9-ae8b1dd8803a service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:30.828670 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-3b96861d-8a04-4ed6-b7c3-fa141a71aa28 req-cd6103ed-042b-47df-81e9-ae8b1dd8803a service nova] Creating event network-changed:e224a14c-9b7e-409c-aa96-28fe27b7f502 for instance 447f6c66-64aa-4e88-a317-27c64b4d82ea on hv-cinder-85442 Aug 31 12:59:30.834858 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-3b96861d-8a04-4ed6-b7c3-fa141a71aa28 req-cd6103ed-042b-47df-81e9-ae8b1dd8803a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073058 Aug 31 12:59:30.835467 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 49/85] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 12:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:59:31.017327 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-75bae18c-7e84-4ff8-bef7-b96ae723e2cd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:31.025787 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-75bae18c-7e84-4ff8-bef7-b96ae723e2cd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1363 microversion: 2.1 time: 0.378946 Aug 31 12:59:31.026348 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 37/86] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:30 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1363 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:59:31.072790 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-4cb2b1a5-31d6-40a6-a6fb-de4830544a2b tempest-VolumesGetTestJSON-2018176503 tempest-VolumesGetTestJSON-2018176503-project] Calling method '.version_select at 0x7f1951763dc0>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:31.106459 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.wsgi [None req-4cb2b1a5-31d6-40a6-a6fb-de4830544a2b tempest-VolumesGetTestJSON-2018176503 tempest-VolumesGetTestJSON-2018176503-project] HTTP exception thrown: Volume 4984f689-3fe7-4916-a36d-2faa739eea30 could not be found. Aug 31 12:59:31.109276 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-4cb2b1a5-31d6-40a6-a6fb-de4830544a2b tempest-VolumesGetTestJSON-2018176503 tempest-VolumesGetTestJSON-2018176503-project] Request method failure captured: Aug 31 12:59:31.109276 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: request: GET /compute/v2.1/os-volumes/4984f689-3fe7-4916-a36d-2faa739eea30 HTTP/1.1 Aug 31 12:59:31.109276 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept: application/json Aug 31 12:59:31.109276 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept-Encoding: identity Aug 31 12:59:31.109276 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Connection: close Aug 31 12:59:31.109276 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Length: 0 Aug 31 12:59:31.109276 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Type: application/json Aug 31 12:59:31.109276 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Host: 10.222.0.58 Aug 31 12:59:31.109276 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Openstack-System-Scope: None Aug 31 12:59:31.109276 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: User-Agent: python-urllib3/1.26.12 Aug 31 12:59:31.109276 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Auth-Token: gAAAAABjD1suEXHjA0-iyOlgoFHe1hiprxPhEEwjEwHJzxAp5HAVR99fmuXvrFhhUnm20_2iSl96S7BGfJb1f2rwGlVpUD6cIdgvpKRc-mXydHg5TdEbR-pHKqQ_02hn14g_Fy4UQQdtrwuSkcif6cP0s3q0X7RwLK3OpUFOAY0KfeDKikgvHq8 Aug 31 12:59:31.109276 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Id: None Aug 31 12:59:31.109276 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Name: None Aug 31 12:59:31.109276 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Identity-Status: Confirmed Aug 31 12:59:31.109276 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Is-Admin-Project: True Aug 31 12:59:31.109276 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Id: default Aug 31 12:59:31.109276 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Name: Default Aug 31 12:59:31.109276 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Id: d67d85f69afb4322814fdd67f4396084 Aug 31 12:59:31.109276 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Name: tempest-VolumesGetTestJSON-2018176503 Aug 31 12:59:31.109276 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Role: member,reader Aug 31 12:59:31.109276 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Roles: member,reader Aug 31 12:59:31.110630 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d67d85f69afb4322814fdd67f4396084"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d67d85f69afb4322814fdd67f4396084"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d67d85f69afb4322814fdd67f4396084"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d67d85f69afb4322814fdd67f4396084"}]}] Aug 31 12:59:31.110630 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant: tempest-VolumesGetTestJSON-2018176503 Aug 31 12:59:31.110630 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Id: d67d85f69afb4322814fdd67f4396084 Aug 31 12:59:31.110630 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Name: tempest-VolumesGetTestJSON-2018176503 Aug 31 12:59:31.110630 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User: tempest-VolumesGetTestJSON-2018176503-project Aug 31 12:59:31.110630 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Id: default Aug 31 12:59:31.110630 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Name: Default Aug 31 12:59:31.110630 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Id: 410227016c654044a4140c048f7840df Aug 31 12:59:31.110630 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Name: tempest-VolumesGetTestJSON-2018176503-project Aug 31 12:59:31.110630 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: method: Aug 31 12:59:31.110630 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: exception: Volume 4984f689-3fe7-4916-a36d-2faa739eea30 could not be found. Aug 31 12:59:31.110630 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: action_args: {'id': '4984f689-3fe7-4916-a36d-2faa739eea30'} Aug 31 12:59:31.110630 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:59:31.111346 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:59:31.111346 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 12:59:31.111346 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 12:59:31.111346 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 12:59:31.111346 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 12:59:31.111346 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 12:59:31.111346 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 12:59:31.111346 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 12:59:31.111346 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 12:59:31.111346 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 12:59:31.111346 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 12:59:31.111346 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:59:31.111346 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:59:31.111346 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:59:31.111346 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:59:31.111346 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4984f689-3fe7-4916-a36d-2faa739eea30 could not be found. (HTTP 404) (Request-ID: req-05815920-c4a5-473c-9df0-3c08973d9b97) Aug 31 12:59:31.111346 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:59:31.111346 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:59:31.111346 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:59:31.112415 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:59:31.112415 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 12:59:31.112415 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 12:59:31.112415 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 12:59:31.112415 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 12:59:31.112415 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 12:59:31.112415 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 12:59:31.112415 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 12:59:31.112415 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 12:59:31.112415 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 12:59:31.112415 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 12:59:31.112415 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 12:59:31.112415 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 12:59:31.112415 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 12:59:31.112415 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 12:59:31.112415 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 12:59:31.112415 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 12:59:31.112415 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 12:59:31.112415 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 12:59:31.113367 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:59:31.113367 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:59:31.113367 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:59:31.113367 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:59:31.113367 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4984f689-3fe7-4916-a36d-2faa739eea30 could not be found. Aug 31 12:59:31.113367 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:59:31.113367 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:59:31.113367 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:59:31.113367 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:59:31.113367 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:59:31.113367 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:59:31.113367 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:59:31.113367 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:59:31.113367 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 12:59:31.113367 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 12:59:31.113367 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:59:31.113367 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:59:31.113367 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 12:59:31.113367 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:59:31.114404 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4984f689-3fe7-4916-a36d-2faa739eea30 could not be found. Aug 31 12:59:31.114404 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:59:31.114404 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:59:31.114404 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:59:31.114404 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:59:31.114404 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:59:31.114404 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:59:31.114404 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:59:31.114404 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:59:31.114404 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4984f689-3fe7-4916-a36d-2faa739eea30 could not be found. Aug 31 12:59:31.114404 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 12:59:31.116623 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-4cb2b1a5-31d6-40a6-a6fb-de4830544a2b tempest-VolumesGetTestJSON-2018176503 tempest-VolumesGetTestJSON-2018176503-project] Returning 404 to user: Volume 4984f689-3fe7-4916-a36d-2faa739eea30 could not be found. {{(pid=120704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:59:31.117480 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-4cb2b1a5-31d6-40a6-a6fb-de4830544a2b tempest-VolumesGetTestJSON-2018176503 tempest-VolumesGetTestJSON-2018176503-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/4984f689-3fe7-4916-a36d-2faa739eea30" status: 404 len: 109 microversion: 2.1 time: 0.048960 Aug 31 12:59:31.118074 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 50/87] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 31 12:59:31 2022] GET /compute/v2.1/os-volumes/4984f689-3fe7-4916-a36d-2faa739eea30 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:59:31.426389 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-284c6352-ba7c-44a8-96dd-8c1276c51e20 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:31.426969 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-284c6352-ba7c-44a8-96dd-8c1276c51e20 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:31.439772 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-284c6352-ba7c-44a8-96dd-8c1276c51e20 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:31.441211 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-284c6352-ba7c-44a8-96dd-8c1276c51e20 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:31.441748 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-284c6352-ba7c-44a8-96dd-8c1276c51e20 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:31.444495 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-284c6352-ba7c-44a8-96dd-8c1276c51e20 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:31.445238 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-284c6352-ba7c-44a8-96dd-8c1276c51e20 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:31.446252 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-284c6352-ba7c-44a8-96dd-8c1276c51e20 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:31.698018 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-284c6352-ba7c-44a8-96dd-8c1276c51e20 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:31.709408 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-284c6352-ba7c-44a8-96dd-8c1276c51e20 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1321 microversion: 2.1 time: 0.284679 Aug 31 12:59:31.726162 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 38/88] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:31 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1321 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:31.784066 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-0cabf55a-ec3f-429c-974f-445b36abe8da tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:31.784852 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-0cabf55a-ec3f-429c-974f-445b36abe8da tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:31.801580 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0cabf55a-ec3f-429c-974f-445b36abe8da tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:31.802086 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0cabf55a-ec3f-429c-974f-445b36abe8da tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:31.804610 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0cabf55a-ec3f-429c-974f-445b36abe8da tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:31.807294 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0cabf55a-ec3f-429c-974f-445b36abe8da tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:31.808036 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0cabf55a-ec3f-429c-974f-445b36abe8da tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:31.809361 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0cabf55a-ec3f-429c-974f-445b36abe8da tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:32.051255 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-fb7050b8-2eeb-4a1e-8f41-394f27966edd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:32.052153 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-fb7050b8-2eeb-4a1e-8f41-394f27966edd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:32.058736 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-0cabf55a-ec3f-429c-974f-445b36abe8da tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63adaf56e417cba603f908a8e451c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0eff3111a5847a68620fce8060df208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:32.062536 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell1:SELECT=100 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:59:32.070068 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-0cabf55a-ec3f-429c-974f-445b36abe8da tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 200 len: 1315 microversion: 2.1 time: 0.292227 Aug 31 12:59:32.071533 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 51/89] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:31 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:32.075155 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fb7050b8-2eeb-4a1e-8f41-394f27966edd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:32.075646 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fb7050b8-2eeb-4a1e-8f41-394f27966edd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:32.076121 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fb7050b8-2eeb-4a1e-8f41-394f27966edd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:32.076852 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fb7050b8-2eeb-4a1e-8f41-394f27966edd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:32.077282 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fb7050b8-2eeb-4a1e-8f41-394f27966edd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:32.077698 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fb7050b8-2eeb-4a1e-8f41-394f27966edd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:32.269218 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-fb7050b8-2eeb-4a1e-8f41-394f27966edd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:32.287199 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-fb7050b8-2eeb-4a1e-8f41-394f27966edd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1363 microversion: 2.1 time: 0.241429 Aug 31 12:59:32.287847 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 39/90] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:32 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:59:32.742826 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-9358b8c0-0092-41f1-ba9d-c20e9eb2e626 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:32.743614 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-9358b8c0-0092-41f1-ba9d-c20e9eb2e626 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:32.750428 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9358b8c0-0092-41f1-ba9d-c20e9eb2e626 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:32.750984 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9358b8c0-0092-41f1-ba9d-c20e9eb2e626 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:32.751499 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9358b8c0-0092-41f1-ba9d-c20e9eb2e626 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:32.752286 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9358b8c0-0092-41f1-ba9d-c20e9eb2e626 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:32.753034 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9358b8c0-0092-41f1-ba9d-c20e9eb2e626 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:32.753525 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9358b8c0-0092-41f1-ba9d-c20e9eb2e626 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:32.973262 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-9358b8c0-0092-41f1-ba9d-c20e9eb2e626 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:32.981797 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-9358b8c0-0092-41f1-ba9d-c20e9eb2e626 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1321 microversion: 2.1 time: 0.244385 Aug 31 12:59:32.984070 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 52/91] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:32 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1321 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:33.092421 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-209e78f0-60d0-47db-81d3-96e909a10cfe tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:33.093151 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-209e78f0-60d0-47db-81d3-96e909a10cfe tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:33.099763 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-209e78f0-60d0-47db-81d3-96e909a10cfe tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:33.100663 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-209e78f0-60d0-47db-81d3-96e909a10cfe tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:33.101309 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-209e78f0-60d0-47db-81d3-96e909a10cfe tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:33.102080 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-209e78f0-60d0-47db-81d3-96e909a10cfe tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:33.102529 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-209e78f0-60d0-47db-81d3-96e909a10cfe tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:33.102948 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-209e78f0-60d0-47db-81d3-96e909a10cfe tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:33.311374 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-fa0b6af9-12ee-4440-ab53-f74d339c6b98 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:33.312029 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-fa0b6af9-12ee-4440-ab53-f74d339c6b98 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:33.319875 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fa0b6af9-12ee-4440-ab53-f74d339c6b98 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:33.324650 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fa0b6af9-12ee-4440-ab53-f74d339c6b98 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:33.325392 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fa0b6af9-12ee-4440-ab53-f74d339c6b98 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:33.326340 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fa0b6af9-12ee-4440-ab53-f74d339c6b98 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:33.326798 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fa0b6af9-12ee-4440-ab53-f74d339c6b98 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:33.327228 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fa0b6af9-12ee-4440-ab53-f74d339c6b98 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:33.358987 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-209e78f0-60d0-47db-81d3-96e909a10cfe tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63adaf56e417cba603f908a8e451c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0eff3111a5847a68620fce8060df208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:33.368622 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-209e78f0-60d0-47db-81d3-96e909a10cfe tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 200 len: 1315 microversion: 2.1 time: 0.280640 Aug 31 12:59:33.373153 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 40/92] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:33 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:33.626598 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-fa0b6af9-12ee-4440-ab53-f74d339c6b98 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:33.640177 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-fa0b6af9-12ee-4440-ab53-f74d339c6b98 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1363 microversion: 2.1 time: 0.333487 Aug 31 12:59:33.641527 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 53/93] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:33 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1363 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:59:34.004993 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-96f5c35f-5205-410a-9b07-a03e67ac75ea tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:34.005793 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-96f5c35f-5205-410a-9b07-a03e67ac75ea tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:34.019037 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-96f5c35f-5205-410a-9b07-a03e67ac75ea tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:34.021321 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-96f5c35f-5205-410a-9b07-a03e67ac75ea tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:34.023042 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-96f5c35f-5205-410a-9b07-a03e67ac75ea tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:34.026134 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-96f5c35f-5205-410a-9b07-a03e67ac75ea tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:34.026928 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-96f5c35f-5205-410a-9b07-a03e67ac75ea tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:34.029535 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-96f5c35f-5205-410a-9b07-a03e67ac75ea tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:34.335891 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-96f5c35f-5205-410a-9b07-a03e67ac75ea tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:34.339493 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=100 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:59:34.346730 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-96f5c35f-5205-410a-9b07-a03e67ac75ea tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1321 microversion: 2.1 time: 0.347931 Aug 31 12:59:34.348588 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 41/94] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:33 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1321 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:34.398278 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-e6597f8b-0a26-431a-81d0-f035620513a5 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:34.399070 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-e6597f8b-0a26-431a-81d0-f035620513a5 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:34.405290 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e6597f8b-0a26-431a-81d0-f035620513a5 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:34.406085 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e6597f8b-0a26-431a-81d0-f035620513a5 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:34.406515 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e6597f8b-0a26-431a-81d0-f035620513a5 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:34.407364 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e6597f8b-0a26-431a-81d0-f035620513a5 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:34.407998 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e6597f8b-0a26-431a-81d0-f035620513a5 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:34.408567 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e6597f8b-0a26-431a-81d0-f035620513a5 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:34.582258 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-e6597f8b-0a26-431a-81d0-f035620513a5 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63adaf56e417cba603f908a8e451c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0eff3111a5847a68620fce8060df208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:34.591917 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-e6597f8b-0a26-431a-81d0-f035620513a5 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 200 len: 1315 microversion: 2.1 time: 0.196847 Aug 31 12:59:34.605162 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 54/95] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:34 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:34.664058 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-f14dc300-a5d5-4e0f-8606-fc04da246da6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:34.665276 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-f14dc300-a5d5-4e0f-8606-fc04da246da6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:34.673597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f14dc300-a5d5-4e0f-8606-fc04da246da6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:34.674634 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f14dc300-a5d5-4e0f-8606-fc04da246da6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:34.675932 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f14dc300-a5d5-4e0f-8606-fc04da246da6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:34.676829 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f14dc300-a5d5-4e0f-8606-fc04da246da6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:34.677454 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f14dc300-a5d5-4e0f-8606-fc04da246da6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:34.678814 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f14dc300-a5d5-4e0f-8606-fc04da246da6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:34.892303 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-f14dc300-a5d5-4e0f-8606-fc04da246da6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:34.903334 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-f14dc300-a5d5-4e0f-8606-fc04da246da6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1363 microversion: 2.1 time: 0.245811 Aug 31 12:59:34.905513 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 42/96] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:34 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1363 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:35.377873 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-549349ce-d1ef-4a85-9677-aa83d78c5008 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:35.378768 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-549349ce-d1ef-4a85-9677-aa83d78c5008 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:35.395582 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-549349ce-d1ef-4a85-9677-aa83d78c5008 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:35.397325 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-549349ce-d1ef-4a85-9677-aa83d78c5008 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:35.397900 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-549349ce-d1ef-4a85-9677-aa83d78c5008 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:35.401078 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-549349ce-d1ef-4a85-9677-aa83d78c5008 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:35.402977 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-549349ce-d1ef-4a85-9677-aa83d78c5008 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:35.403932 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-549349ce-d1ef-4a85-9677-aa83d78c5008 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:35.617219 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-304b6988-0618-43a0-86c9-7d8947d8c1e6 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:35.619602 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-304b6988-0618-43a0-86c9-7d8947d8c1e6 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:35.627754 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-304b6988-0618-43a0-86c9-7d8947d8c1e6 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:35.628274 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-304b6988-0618-43a0-86c9-7d8947d8c1e6 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:35.628721 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-304b6988-0618-43a0-86c9-7d8947d8c1e6 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:35.629450 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-304b6988-0618-43a0-86c9-7d8947d8c1e6 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:35.630347 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-304b6988-0618-43a0-86c9-7d8947d8c1e6 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:35.631100 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-304b6988-0618-43a0-86c9-7d8947d8c1e6 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:36.142346 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-549349ce-d1ef-4a85-9677-aa83d78c5008 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:36.153070 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-549349ce-d1ef-4a85-9677-aa83d78c5008 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1321 microversion: 2.1 time: 0.783415 Aug 31 12:59:36.153654 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 55/97] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:35 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1321 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:36.166697 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-304b6988-0618-43a0-86c9-7d8947d8c1e6 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63adaf56e417cba603f908a8e451c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0eff3111a5847a68620fce8060df208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:36.173974 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-9d711697-2bb1-48d7-ac37-0452c9c799ad tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:36.177243 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-9d711697-2bb1-48d7-ac37-0452c9c799ad tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:36.184246 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-304b6988-0618-43a0-86c9-7d8947d8c1e6 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 200 len: 1315 microversion: 2.1 time: 0.572706 Aug 31 12:59:36.187694 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 43/98] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:35 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 1315 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:36.194274 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9d711697-2bb1-48d7-ac37-0452c9c799ad tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:36.196724 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9d711697-2bb1-48d7-ac37-0452c9c799ad tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:36.197333 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9d711697-2bb1-48d7-ac37-0452c9c799ad tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:36.203955 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9d711697-2bb1-48d7-ac37-0452c9c799ad tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:36.204574 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9d711697-2bb1-48d7-ac37-0452c9c799ad tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:36.205142 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9d711697-2bb1-48d7-ac37-0452c9c799ad tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:36.369713 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-9d711697-2bb1-48d7-ac37-0452c9c799ad tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:36.381292 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-9d711697-2bb1-48d7-ac37-0452c9c799ad tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1363 microversion: 2.1 time: 0.224347 Aug 31 12:59:36.382173 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 56/99] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:36 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:37.193002 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-ff07c0e3-029c-4fcb-9318-f0f566c00246 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:37.199064 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-ff07c0e3-029c-4fcb-9318-f0f566c00246 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:37.208844 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ff07c0e3-029c-4fcb-9318-f0f566c00246 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:37.209852 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ff07c0e3-029c-4fcb-9318-f0f566c00246 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:37.211502 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ff07c0e3-029c-4fcb-9318-f0f566c00246 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:37.212375 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ff07c0e3-029c-4fcb-9318-f0f566c00246 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:37.212977 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ff07c0e3-029c-4fcb-9318-f0f566c00246 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:37.213198 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-5bd3066b-ea21-46d8-99fe-eeb8b0492fe2 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:37.214014 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-5bd3066b-ea21-46d8-99fe-eeb8b0492fe2 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:37.214584 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ff07c0e3-029c-4fcb-9318-f0f566c00246 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:37.221056 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5bd3066b-ea21-46d8-99fe-eeb8b0492fe2 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:37.221637 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5bd3066b-ea21-46d8-99fe-eeb8b0492fe2 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:37.222160 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5bd3066b-ea21-46d8-99fe-eeb8b0492fe2 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:37.223033 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5bd3066b-ea21-46d8-99fe-eeb8b0492fe2 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:37.223656 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5bd3066b-ea21-46d8-99fe-eeb8b0492fe2 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:37.224264 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5bd3066b-ea21-46d8-99fe-eeb8b0492fe2 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:37.431468 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-ff07c0e3-029c-4fcb-9318-f0f566c00246 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:37.444470 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-ff07c0e3-029c-4fcb-9318-f0f566c00246 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1321 microversion: 2.1 time: 0.272835 Aug 31 12:59:37.445057 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 44/100] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:37 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1321 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:37.449880 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-5bd3066b-ea21-46d8-99fe-eeb8b0492fe2 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63adaf56e417cba603f908a8e451c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0eff3111a5847a68620fce8060df208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:37.450030 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-23dc46d9-8cbf-4d2e-b3e7-cc372f471d4e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:37.450822 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-23dc46d9-8cbf-4d2e-b3e7-cc372f471d4e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:37.457327 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-23dc46d9-8cbf-4d2e-b3e7-cc372f471d4e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:37.457327 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-23dc46d9-8cbf-4d2e-b3e7-cc372f471d4e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:37.457712 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-23dc46d9-8cbf-4d2e-b3e7-cc372f471d4e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:37.458357 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-5bd3066b-ea21-46d8-99fe-eeb8b0492fe2 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 200 len: 1315 microversion: 2.1 time: 0.249920 Aug 31 12:59:37.458679 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-23dc46d9-8cbf-4d2e-b3e7-cc372f471d4e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:37.459128 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-23dc46d9-8cbf-4d2e-b3e7-cc372f471d4e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:37.459472 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 57/101] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:37 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:37.459591 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-23dc46d9-8cbf-4d2e-b3e7-cc372f471d4e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:37.682330 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-23dc46d9-8cbf-4d2e-b3e7-cc372f471d4e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:37.691293 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-23dc46d9-8cbf-4d2e-b3e7-cc372f471d4e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1363 microversion: 2.1 time: 0.244258 Aug 31 12:59:37.692464 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 45/102] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:37 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:38.465685 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-6665dd27-0dc6-4796-a797-dee32636870d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:38.466293 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-6665dd27-0dc6-4796-a797-dee32636870d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:38.476059 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6665dd27-0dc6-4796-a797-dee32636870d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:38.476059 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6665dd27-0dc6-4796-a797-dee32636870d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:38.476059 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6665dd27-0dc6-4796-a797-dee32636870d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:38.476059 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6665dd27-0dc6-4796-a797-dee32636870d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:38.476381 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6665dd27-0dc6-4796-a797-dee32636870d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:38.476381 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6665dd27-0dc6-4796-a797-dee32636870d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:38.486595 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-60fbceb1-cfb3-4973-b4c4-a3a83fec7938 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:38.488840 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-60fbceb1-cfb3-4973-b4c4-a3a83fec7938 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:38.490791 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=2 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:59:38.492245 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=6 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:59:38.498949 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-60fbceb1-cfb3-4973-b4c4-a3a83fec7938 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:38.499795 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-60fbceb1-cfb3-4973-b4c4-a3a83fec7938 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:38.500944 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-60fbceb1-cfb3-4973-b4c4-a3a83fec7938 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:38.502547 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-60fbceb1-cfb3-4973-b4c4-a3a83fec7938 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:38.503163 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-60fbceb1-cfb3-4973-b4c4-a3a83fec7938 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:38.503746 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-60fbceb1-cfb3-4973-b4c4-a3a83fec7938 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:38.614988 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell0:SELECT=2 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:59:38.667585 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-6665dd27-0dc6-4796-a797-dee32636870d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:38.683492 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-6665dd27-0dc6-4796-a797-dee32636870d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1321 microversion: 2.1 time: 0.220664 Aug 31 12:59:38.685008 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 58/103] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:38 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:38.713025 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-85c11ffd-8150-4f50-b720-2b9a833fc0fc tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:38.713635 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-85c11ffd-8150-4f50-b720-2b9a833fc0fc tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:38.725316 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-85c11ffd-8150-4f50-b720-2b9a833fc0fc tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:38.725974 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-85c11ffd-8150-4f50-b720-2b9a833fc0fc tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:38.726552 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-85c11ffd-8150-4f50-b720-2b9a833fc0fc tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:38.728480 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-85c11ffd-8150-4f50-b720-2b9a833fc0fc tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:38.730598 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-85c11ffd-8150-4f50-b720-2b9a833fc0fc tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:38.731052 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-85c11ffd-8150-4f50-b720-2b9a833fc0fc tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:38.732220 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-60fbceb1-cfb3-4973-b4c4-a3a83fec7938 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63adaf56e417cba603f908a8e451c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0eff3111a5847a68620fce8060df208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:38.741730 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-60fbceb1-cfb3-4973-b4c4-a3a83fec7938 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 200 len: 1315 microversion: 2.1 time: 0.258409 Aug 31 12:59:38.744642 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 46/104] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:38 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:38.894525 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-85c11ffd-8150-4f50-b720-2b9a833fc0fc tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:38.905392 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-85c11ffd-8150-4f50-b720-2b9a833fc0fc tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1363 microversion: 2.1 time: 0.197010 Aug 31 12:59:38.906847 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 59/105] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:38 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1363 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:39.708365 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-6f1ffec3-fe8b-449c-8a74-c040810e7ea1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:39.708365 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-6f1ffec3-fe8b-449c-8a74-c040810e7ea1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:39.715010 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6f1ffec3-fe8b-449c-8a74-c040810e7ea1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:39.715881 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6f1ffec3-fe8b-449c-8a74-c040810e7ea1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:39.716774 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6f1ffec3-fe8b-449c-8a74-c040810e7ea1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:39.717913 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6f1ffec3-fe8b-449c-8a74-c040810e7ea1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:39.718459 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6f1ffec3-fe8b-449c-8a74-c040810e7ea1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:39.718952 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6f1ffec3-fe8b-449c-8a74-c040810e7ea1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:39.767202 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-e172f83e-a3b2-485d-9411-bcce9935a662 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:39.767804 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-e172f83e-a3b2-485d-9411-bcce9935a662 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:39.774616 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e172f83e-a3b2-485d-9411-bcce9935a662 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:39.775136 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e172f83e-a3b2-485d-9411-bcce9935a662 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:39.775576 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e172f83e-a3b2-485d-9411-bcce9935a662 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:39.776502 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e172f83e-a3b2-485d-9411-bcce9935a662 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:39.776946 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e172f83e-a3b2-485d-9411-bcce9935a662 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:39.777417 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e172f83e-a3b2-485d-9411-bcce9935a662 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:39.921015 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-6f1ffec3-fe8b-449c-8a74-c040810e7ea1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:39.930276 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-6f1ffec3-fe8b-449c-8a74-c040810e7ea1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1321 microversion: 2.1 time: 0.227399 Aug 31 12:59:39.930869 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 47/106] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:39 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1321 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:39.940362 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-77263632-61c0-4e39-aacc-621114465bdc tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:39.942560 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-77263632-61c0-4e39-aacc-621114465bdc tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:39.950048 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-77263632-61c0-4e39-aacc-621114465bdc tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:39.950750 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-77263632-61c0-4e39-aacc-621114465bdc tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:39.951331 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-77263632-61c0-4e39-aacc-621114465bdc tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:39.952481 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-77263632-61c0-4e39-aacc-621114465bdc tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:39.953075 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-77263632-61c0-4e39-aacc-621114465bdc tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:39.954329 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-77263632-61c0-4e39-aacc-621114465bdc tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:39.987521 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-e172f83e-a3b2-485d-9411-bcce9935a662 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63adaf56e417cba603f908a8e451c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0eff3111a5847a68620fce8060df208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:39.995860 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-e172f83e-a3b2-485d-9411-bcce9935a662 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 200 len: 1315 microversion: 2.1 time: 0.232447 Aug 31 12:59:39.997028 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 60/107] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:39 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:40.116750 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-77263632-61c0-4e39-aacc-621114465bdc tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:40.125212 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-77263632-61c0-4e39-aacc-621114465bdc tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1363 microversion: 2.1 time: 0.193345 Aug 31 12:59:40.125792 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 48/108] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:39 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1363 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:40.951054 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-e86a20d7-8698-4e91-8c98-07a1775c6286 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:40.952104 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-e86a20d7-8698-4e91-8c98-07a1775c6286 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:40.958210 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e86a20d7-8698-4e91-8c98-07a1775c6286 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:40.958685 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e86a20d7-8698-4e91-8c98-07a1775c6286 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:40.959117 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e86a20d7-8698-4e91-8c98-07a1775c6286 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:40.959801 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e86a20d7-8698-4e91-8c98-07a1775c6286 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:40.960273 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e86a20d7-8698-4e91-8c98-07a1775c6286 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:40.960686 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e86a20d7-8698-4e91-8c98-07a1775c6286 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:41.016351 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e5754fb3-cbda-498b-bcce-320f52cdd588 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:41.016961 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e5754fb3-cbda-498b-bcce-320f52cdd588 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:41.027264 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e5754fb3-cbda-498b-bcce-320f52cdd588 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:41.027886 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e5754fb3-cbda-498b-bcce-320f52cdd588 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:41.028311 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e5754fb3-cbda-498b-bcce-320f52cdd588 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:41.029358 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e5754fb3-cbda-498b-bcce-320f52cdd588 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:41.029970 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e5754fb3-cbda-498b-bcce-320f52cdd588 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:41.030514 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e5754fb3-cbda-498b-bcce-320f52cdd588 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:41.137217 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-e86a20d7-8698-4e91-8c98-07a1775c6286 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:41.146313 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-e86a20d7-8698-4e91-8c98-07a1775c6286 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1321 microversion: 2.1 time: 0.199260 Aug 31 12:59:41.147301 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 61/109] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:40 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:41.153024 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-14e0b815-9a36-41d9-9382-653bfa0b9152 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:41.153801 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-14e0b815-9a36-41d9-9382-653bfa0b9152 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:41.160780 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-14e0b815-9a36-41d9-9382-653bfa0b9152 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:41.161362 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-14e0b815-9a36-41d9-9382-653bfa0b9152 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:41.161837 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-14e0b815-9a36-41d9-9382-653bfa0b9152 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:41.162619 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-14e0b815-9a36-41d9-9382-653bfa0b9152 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:41.163066 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-14e0b815-9a36-41d9-9382-653bfa0b9152 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:41.163490 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-14e0b815-9a36-41d9-9382-653bfa0b9152 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:41.196628 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e5754fb3-cbda-498b-bcce-320f52cdd588 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63adaf56e417cba603f908a8e451c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0eff3111a5847a68620fce8060df208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:41.205439 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e5754fb3-cbda-498b-bcce-320f52cdd588 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 200 len: 1315 microversion: 2.1 time: 0.193115 Aug 31 12:59:41.206100 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 49/110] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:41 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:59:41.305369 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-14e0b815-9a36-41d9-9382-653bfa0b9152 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:41.313392 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-14e0b815-9a36-41d9-9382-653bfa0b9152 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1363 microversion: 2.1 time: 0.164809 Aug 31 12:59:41.314270 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 62/111] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:41 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:42.167438 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-5146f747-e7d1-4a98-b9e7-6fa8a01e4503 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:42.168088 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-5146f747-e7d1-4a98-b9e7-6fa8a01e4503 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:42.174121 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5146f747-e7d1-4a98-b9e7-6fa8a01e4503 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:42.174602 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5146f747-e7d1-4a98-b9e7-6fa8a01e4503 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:42.175034 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5146f747-e7d1-4a98-b9e7-6fa8a01e4503 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:42.175716 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5146f747-e7d1-4a98-b9e7-6fa8a01e4503 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:42.176192 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5146f747-e7d1-4a98-b9e7-6fa8a01e4503 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:42.176608 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5146f747-e7d1-4a98-b9e7-6fa8a01e4503 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:42.226408 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-67b178b4-a30c-4397-b8a1-468a66b56a36 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:42.227022 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-67b178b4-a30c-4397-b8a1-468a66b56a36 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:42.234689 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-67b178b4-a30c-4397-b8a1-468a66b56a36 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:42.235357 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-67b178b4-a30c-4397-b8a1-468a66b56a36 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:42.236177 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-67b178b4-a30c-4397-b8a1-468a66b56a36 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:42.236872 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-67b178b4-a30c-4397-b8a1-468a66b56a36 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:42.237312 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-67b178b4-a30c-4397-b8a1-468a66b56a36 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:42.237889 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-67b178b4-a30c-4397-b8a1-468a66b56a36 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:42.383434 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-5146f747-e7d1-4a98-b9e7-6fa8a01e4503 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:42.395192 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-5146f747-e7d1-4a98-b9e7-6fa8a01e4503 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1321 microversion: 2.1 time: 0.232454 Aug 31 12:59:42.396194 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 50/112] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:42 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:42.402769 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b4eb0836-0614-4609-b596-f7c649607da2 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:42.403582 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b4eb0836-0614-4609-b596-f7c649607da2 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:42.411574 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b4eb0836-0614-4609-b596-f7c649607da2 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:42.412277 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b4eb0836-0614-4609-b596-f7c649607da2 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:42.412873 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b4eb0836-0614-4609-b596-f7c649607da2 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:42.414025 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b4eb0836-0614-4609-b596-f7c649607da2 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:42.414694 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b4eb0836-0614-4609-b596-f7c649607da2 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:42.415594 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b4eb0836-0614-4609-b596-f7c649607da2 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:42.432837 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-67b178b4-a30c-4397-b8a1-468a66b56a36 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63adaf56e417cba603f908a8e451c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0eff3111a5847a68620fce8060df208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:42.444494 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-67b178b4-a30c-4397-b8a1-468a66b56a36 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 200 len: 1315 microversion: 2.1 time: 0.221707 Aug 31 12:59:42.445871 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 63/113] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:42 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:59:42.578087 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-b4eb0836-0614-4609-b596-f7c649607da2 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:42.586525 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b4eb0836-0614-4609-b596-f7c649607da2 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1363 microversion: 2.1 time: 0.188490 Aug 31 12:59:42.587144 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 51/114] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:42 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:43.425276 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-0b5cf4f2-8d13-41aa-8ce9-fe26724bb22d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:43.426109 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-0b5cf4f2-8d13-41aa-8ce9-fe26724bb22d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:43.434284 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0b5cf4f2-8d13-41aa-8ce9-fe26724bb22d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:43.434761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0b5cf4f2-8d13-41aa-8ce9-fe26724bb22d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:43.435189 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0b5cf4f2-8d13-41aa-8ce9-fe26724bb22d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:43.435874 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0b5cf4f2-8d13-41aa-8ce9-fe26724bb22d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:43.436345 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0b5cf4f2-8d13-41aa-8ce9-fe26724bb22d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:43.436762 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0b5cf4f2-8d13-41aa-8ce9-fe26724bb22d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:43.466361 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-80fd4b69-91bd-449e-8f8d-35a32fdd34d6 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:43.466928 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-80fd4b69-91bd-449e-8f8d-35a32fdd34d6 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:43.473614 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-80fd4b69-91bd-449e-8f8d-35a32fdd34d6 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:43.474085 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-80fd4b69-91bd-449e-8f8d-35a32fdd34d6 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:43.474506 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-80fd4b69-91bd-449e-8f8d-35a32fdd34d6 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:43.475182 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-80fd4b69-91bd-449e-8f8d-35a32fdd34d6 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:43.475618 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-80fd4b69-91bd-449e-8f8d-35a32fdd34d6 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:43.476058 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-80fd4b69-91bd-449e-8f8d-35a32fdd34d6 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:43.621269 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-0b5cf4f2-8d13-41aa-8ce9-fe26724bb22d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:43.629528 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-0b5cf4f2-8d13-41aa-8ce9-fe26724bb22d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1321 microversion: 2.1 time: 0.211321 Aug 31 12:59:43.630111 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 64/115] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:43 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:43.634553 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-99d2171c-af06-4f4e-ba0b-08adcb32307d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:43.635108 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-99d2171c-af06-4f4e-ba0b-08adcb32307d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:43.641335 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-99d2171c-af06-4f4e-ba0b-08adcb32307d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:43.641808 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-99d2171c-af06-4f4e-ba0b-08adcb32307d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:43.642230 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-99d2171c-af06-4f4e-ba0b-08adcb32307d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:43.642909 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-99d2171c-af06-4f4e-ba0b-08adcb32307d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:43.643345 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-99d2171c-af06-4f4e-ba0b-08adcb32307d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:43.643844 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-99d2171c-af06-4f4e-ba0b-08adcb32307d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:43.646283 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-80fd4b69-91bd-449e-8f8d-35a32fdd34d6 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63adaf56e417cba603f908a8e451c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0eff3111a5847a68620fce8060df208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:43.654017 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-80fd4b69-91bd-449e-8f8d-35a32fdd34d6 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 200 len: 1315 microversion: 2.1 time: 0.191539 Aug 31 12:59:43.654589 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 52/116] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:43 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:43.772895 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-99d2171c-af06-4f4e-ba0b-08adcb32307d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:43.784764 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-99d2171c-af06-4f4e-ba0b-08adcb32307d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1363 microversion: 2.1 time: 0.153284 Aug 31 12:59:43.785509 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 65/117] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:43 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:44.654843 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-8ea95aa0-3b16-4549-8a48-fff92709134d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:44.655640 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-8ea95aa0-3b16-4549-8a48-fff92709134d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:44.665607 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8ea95aa0-3b16-4549-8a48-fff92709134d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:44.666078 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8ea95aa0-3b16-4549-8a48-fff92709134d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:44.666484 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8ea95aa0-3b16-4549-8a48-fff92709134d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:44.667180 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8ea95aa0-3b16-4549-8a48-fff92709134d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:44.667604 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8ea95aa0-3b16-4549-8a48-fff92709134d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:44.668051 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8ea95aa0-3b16-4549-8a48-fff92709134d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:44.674502 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-faeb69bd-1454-4d67-a467-68e0d06a2579 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:44.675117 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-faeb69bd-1454-4d67-a467-68e0d06a2579 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:44.682038 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-faeb69bd-1454-4d67-a467-68e0d06a2579 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:44.682516 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-faeb69bd-1454-4d67-a467-68e0d06a2579 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:44.682947 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-faeb69bd-1454-4d67-a467-68e0d06a2579 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:44.683663 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-faeb69bd-1454-4d67-a467-68e0d06a2579 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:44.684155 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-faeb69bd-1454-4d67-a467-68e0d06a2579 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:44.684577 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-faeb69bd-1454-4d67-a467-68e0d06a2579 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:44.869912 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-8ea95aa0-3b16-4549-8a48-fff92709134d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:44.875165 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-faeb69bd-1454-4d67-a467-68e0d06a2579 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63adaf56e417cba603f908a8e451c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0eff3111a5847a68620fce8060df208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:44.877768 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-8ea95aa0-3b16-4549-8a48-fff92709134d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1321 microversion: 2.1 time: 0.229501 Aug 31 12:59:44.878346 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 53/118] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:44 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:44.882834 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-04274b5d-61d9-46d5-b026-1461908dc383 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:44.883457 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-04274b5d-61d9-46d5-b026-1461908dc383 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:44.889307 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-faeb69bd-1454-4d67-a467-68e0d06a2579 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 200 len: 1315 microversion: 2.1 time: 0.218467 Aug 31 12:59:44.891726 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-04274b5d-61d9-46d5-b026-1461908dc383 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:44.892448 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-04274b5d-61d9-46d5-b026-1461908dc383 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:44.893066 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-04274b5d-61d9-46d5-b026-1461908dc383 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:44.893284 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 66/119] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:44 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:44.894161 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-04274b5d-61d9-46d5-b026-1461908dc383 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:44.894797 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-04274b5d-61d9-46d5-b026-1461908dc383 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:44.895404 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-04274b5d-61d9-46d5-b026-1461908dc383 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:45.026983 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-04274b5d-61d9-46d5-b026-1461908dc383 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:45.035031 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-04274b5d-61d9-46d5-b026-1461908dc383 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1363 microversion: 2.1 time: 0.155710 Aug 31 12:59:45.035592 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 54/120] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:44 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:45.902713 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-851d6389-4d11-46fc-8d19-c7f2667a77cc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:45.903446 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-851d6389-4d11-46fc-8d19-c7f2667a77cc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:45.912593 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-15043e9e-a7de-473a-911d-44df3dcea701 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:45.913025 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-851d6389-4d11-46fc-8d19-c7f2667a77cc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:45.913331 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-851d6389-4d11-46fc-8d19-c7f2667a77cc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:45.913861 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-851d6389-4d11-46fc-8d19-c7f2667a77cc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:45.914254 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-15043e9e-a7de-473a-911d-44df3dcea701 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:45.915074 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-851d6389-4d11-46fc-8d19-c7f2667a77cc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:45.915620 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-851d6389-4d11-46fc-8d19-c7f2667a77cc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:45.916188 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-851d6389-4d11-46fc-8d19-c7f2667a77cc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:45.922717 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-15043e9e-a7de-473a-911d-44df3dcea701 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:45.923208 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-15043e9e-a7de-473a-911d-44df3dcea701 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:45.923640 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-15043e9e-a7de-473a-911d-44df3dcea701 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:45.924543 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-15043e9e-a7de-473a-911d-44df3dcea701 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:45.924994 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-15043e9e-a7de-473a-911d-44df3dcea701 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:45.925467 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-15043e9e-a7de-473a-911d-44df3dcea701 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:46.125553 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-851d6389-4d11-46fc-8d19-c7f2667a77cc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:46.128518 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-15043e9e-a7de-473a-911d-44df3dcea701 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63adaf56e417cba603f908a8e451c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0eff3111a5847a68620fce8060df208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:46.133494 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-851d6389-4d11-46fc-8d19-c7f2667a77cc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1321 microversion: 2.1 time: 0.234760 Aug 31 12:59:46.134196 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 67/121] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:45 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1321 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:46.136688 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-15043e9e-a7de-473a-911d-44df3dcea701 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 200 len: 1315 microversion: 2.1 time: 0.229463 Aug 31 12:59:46.137259 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 55/122] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:45 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:46.138448 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-3dfd74f8-e0cd-46d6-aaa4-f758a94ebcb1 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:46.139077 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-3dfd74f8-e0cd-46d6-aaa4-f758a94ebcb1 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:46.144998 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3dfd74f8-e0cd-46d6-aaa4-f758a94ebcb1 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:46.145393 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3dfd74f8-e0cd-46d6-aaa4-f758a94ebcb1 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:46.145889 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3dfd74f8-e0cd-46d6-aaa4-f758a94ebcb1 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:46.146475 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3dfd74f8-e0cd-46d6-aaa4-f758a94ebcb1 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:46.147068 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3dfd74f8-e0cd-46d6-aaa4-f758a94ebcb1 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:46.147961 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3dfd74f8-e0cd-46d6-aaa4-f758a94ebcb1 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:46.167526 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell1:SELECT=100 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:59:46.315527 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-3dfd74f8-e0cd-46d6-aaa4-f758a94ebcb1 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:46.323902 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-3dfd74f8-e0cd-46d6-aaa4-f758a94ebcb1 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1363 microversion: 2.1 time: 0.188818 Aug 31 12:59:46.324477 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 68/123] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:46 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:47.154887 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-dcb0b579-38fe-4372-a11c-8c67eb38e5e2 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:47.156846 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-dcb0b579-38fe-4372-a11c-8c67eb38e5e2 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:47.163677 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dcb0b579-38fe-4372-a11c-8c67eb38e5e2 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:47.164181 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dcb0b579-38fe-4372-a11c-8c67eb38e5e2 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:47.165101 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dcb0b579-38fe-4372-a11c-8c67eb38e5e2 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:47.166081 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dcb0b579-38fe-4372-a11c-8c67eb38e5e2 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:47.166669 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dcb0b579-38fe-4372-a11c-8c67eb38e5e2 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:47.167230 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dcb0b579-38fe-4372-a11c-8c67eb38e5e2 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:47.169481 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-3de36240-c6cf-4b87-bfca-46b5ef356178 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:47.174290 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-3de36240-c6cf-4b87-bfca-46b5ef356178 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:47.185047 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3de36240-c6cf-4b87-bfca-46b5ef356178 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:47.185637 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3de36240-c6cf-4b87-bfca-46b5ef356178 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:47.187178 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3de36240-c6cf-4b87-bfca-46b5ef356178 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:47.188065 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3de36240-c6cf-4b87-bfca-46b5ef356178 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:47.189132 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3de36240-c6cf-4b87-bfca-46b5ef356178 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:47.189654 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3de36240-c6cf-4b87-bfca-46b5ef356178 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:47.463926 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-dcb0b579-38fe-4372-a11c-8c67eb38e5e2 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:47.467687 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-3de36240-c6cf-4b87-bfca-46b5ef356178 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63adaf56e417cba603f908a8e451c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0eff3111a5847a68620fce8060df208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:47.474857 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-dcb0b579-38fe-4372-a11c-8c67eb38e5e2 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1321 microversion: 2.1 time: 0.323853 Aug 31 12:59:47.476160 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 56/124] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:47 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1321 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:47.488470 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-3de36240-c6cf-4b87-bfca-46b5ef356178 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 200 len: 1315 microversion: 2.1 time: 0.321389 Aug 31 12:59:47.489651 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 69/125] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:47 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:47.497799 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3502c9f7-fb3b-4603-8bc6-7369d2f437c3 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:47.498231 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-3502c9f7-fb3b-4603-8bc6-7369d2f437c3 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:47.504257 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3502c9f7-fb3b-4603-8bc6-7369d2f437c3 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:47.504874 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3502c9f7-fb3b-4603-8bc6-7369d2f437c3 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:47.505506 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3502c9f7-fb3b-4603-8bc6-7369d2f437c3 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:47.506763 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3502c9f7-fb3b-4603-8bc6-7369d2f437c3 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:47.507446 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3502c9f7-fb3b-4603-8bc6-7369d2f437c3 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:47.507890 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3502c9f7-fb3b-4603-8bc6-7369d2f437c3 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:47.594579 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-6fa9752e-5cc3-4533-8315-8e65d62604a6 req-0465a986-4c87-4d28-bbcc-db9dfb08a98e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "447f6c66-64aa-4e88-a317-27c64b4d82ea", "name": "network-vif-plugged", "status": "completed", "tag": "e224a14c-9b7e-409c-aa96-28fe27b7f502"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:59:47.606903 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-6fa9752e-5cc3-4533-8315-8e65d62604a6 req-0465a986-4c87-4d28-bbcc-db9dfb08a98e service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:47.607361 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-6fa9752e-5cc3-4533-8315-8e65d62604a6 req-0465a986-4c87-4d28-bbcc-db9dfb08a98e service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:47.607972 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-6fa9752e-5cc3-4533-8315-8e65d62604a6 req-0465a986-4c87-4d28-bbcc-db9dfb08a98e service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:47.622672 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-6fa9752e-5cc3-4533-8315-8e65d62604a6 req-0465a986-4c87-4d28-bbcc-db9dfb08a98e service nova] Creating event network-vif-plugged:e224a14c-9b7e-409c-aa96-28fe27b7f502 for instance 447f6c66-64aa-4e88-a317-27c64b4d82ea on hv-cinder-85442 Aug 31 12:59:47.628596 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-6fa9752e-5cc3-4533-8315-8e65d62604a6 req-0465a986-4c87-4d28-bbcc-db9dfb08a98e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137528 Aug 31 12:59:47.629203 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 70/126] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 12:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:59:47.680386 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-3502c9f7-fb3b-4603-8bc6-7369d2f437c3 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:47.689011 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-3502c9f7-fb3b-4603-8bc6-7369d2f437c3 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1363 microversion: 2.1 time: 0.211556 Aug 31 12:59:47.690191 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 57/127] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:47 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1363 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:48.518711 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-09536842-37cc-4279-9105-aeecb5545c38 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:48.519320 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-09536842-37cc-4279-9105-aeecb5545c38 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:48.523855 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-16551580-5e1a-4b0c-b85e-dc79f8dfebdc tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:48.524593 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-16551580-5e1a-4b0c-b85e-dc79f8dfebdc tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:48.525536 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-09536842-37cc-4279-9105-aeecb5545c38 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:48.526117 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-09536842-37cc-4279-9105-aeecb5545c38 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:48.526411 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-09536842-37cc-4279-9105-aeecb5545c38 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:48.527103 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-09536842-37cc-4279-9105-aeecb5545c38 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:48.527543 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-09536842-37cc-4279-9105-aeecb5545c38 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:48.527990 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-09536842-37cc-4279-9105-aeecb5545c38 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:48.530735 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-16551580-5e1a-4b0c-b85e-dc79f8dfebdc tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:48.531417 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-16551580-5e1a-4b0c-b85e-dc79f8dfebdc tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:48.531865 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-16551580-5e1a-4b0c-b85e-dc79f8dfebdc tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:48.532764 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-16551580-5e1a-4b0c-b85e-dc79f8dfebdc tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:48.533220 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-16551580-5e1a-4b0c-b85e-dc79f8dfebdc tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:48.533637 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-16551580-5e1a-4b0c-b85e-dc79f8dfebdc tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:48.546649 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=100 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:59:48.748201 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-16551580-5e1a-4b0c-b85e-dc79f8dfebdc tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63adaf56e417cba603f908a8e451c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0eff3111a5847a68620fce8060df208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:48.756802 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-09536842-37cc-4279-9105-aeecb5545c38 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:48.758136 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-16551580-5e1a-4b0c-b85e-dc79f8dfebdc tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 200 len: 1315 microversion: 2.1 time: 0.246890 Aug 31 12:59:48.759016 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 71/128] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:48 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:48.763982 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-abc78ce6-7ab3-4022-9a22-d92e3eb08b30 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:48.764587 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-abc78ce6-7ab3-4022-9a22-d92e3eb08b30 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:48.766136 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-09536842-37cc-4279-9105-aeecb5545c38 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1321 microversion: 2.1 time: 0.251430 Aug 31 12:59:48.770962 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-abc78ce6-7ab3-4022-9a22-d92e3eb08b30 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:48.771420 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-abc78ce6-7ab3-4022-9a22-d92e3eb08b30 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:48.772208 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-abc78ce6-7ab3-4022-9a22-d92e3eb08b30 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:48.773123 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-abc78ce6-7ab3-4022-9a22-d92e3eb08b30 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:48.773782 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-abc78ce6-7ab3-4022-9a22-d92e3eb08b30 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:48.774197 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-abc78ce6-7ab3-4022-9a22-d92e3eb08b30 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:48.778602 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 58/129] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:48 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1321 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:48.909254 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-abc78ce6-7ab3-4022-9a22-d92e3eb08b30 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:48.918576 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-abc78ce6-7ab3-4022-9a22-d92e3eb08b30 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1363 microversion: 2.1 time: 0.158360 Aug 31 12:59:48.919186 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 72/130] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:48 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:49.778975 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-21a3825b-034a-481b-9b01-c1e23e0d833c tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:49.779937 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-21a3825b-034a-481b-9b01-c1e23e0d833c tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:49.790568 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-5b4c89e3-e752-412f-9e37-60d9ea632951 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:49.791121 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-5b4c89e3-e752-412f-9e37-60d9ea632951 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:49.803450 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-21a3825b-034a-481b-9b01-c1e23e0d833c tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:49.803982 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-21a3825b-034a-481b-9b01-c1e23e0d833c tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:49.804403 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-21a3825b-034a-481b-9b01-c1e23e0d833c tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:49.805096 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-21a3825b-034a-481b-9b01-c1e23e0d833c tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:49.806833 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-21a3825b-034a-481b-9b01-c1e23e0d833c tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:49.806833 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-21a3825b-034a-481b-9b01-c1e23e0d833c tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:49.810151 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5b4c89e3-e752-412f-9e37-60d9ea632951 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:49.810733 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5b4c89e3-e752-412f-9e37-60d9ea632951 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:49.811171 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5b4c89e3-e752-412f-9e37-60d9ea632951 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:49.811931 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5b4c89e3-e752-412f-9e37-60d9ea632951 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:49.812376 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5b4c89e3-e752-412f-9e37-60d9ea632951 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:49.812788 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5b4c89e3-e752-412f-9e37-60d9ea632951 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:50.107590 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-5b4c89e3-e752-412f-9e37-60d9ea632951 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:50.115768 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-5b4c89e3-e752-412f-9e37-60d9ea632951 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1321 microversion: 2.1 time: 0.330009 Aug 31 12:59:50.116627 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 73/131] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:49 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1321 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:50.121169 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-21a3825b-034a-481b-9b01-c1e23e0d833c tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63adaf56e417cba603f908a8e451c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0eff3111a5847a68620fce8060df208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:50.122242 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-6ef671fe-3cf3-42ed-9658-474b58a8bbc7 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:50.123143 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-6ef671fe-3cf3-42ed-9658-474b58a8bbc7 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:50.129665 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6ef671fe-3cf3-42ed-9658-474b58a8bbc7 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:50.130480 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6ef671fe-3cf3-42ed-9658-474b58a8bbc7 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:50.130971 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-21a3825b-034a-481b-9b01-c1e23e0d833c tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 200 len: 1315 microversion: 2.1 time: 0.356090 Aug 31 12:59:50.139833 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 59/132] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:49 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 1315 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:50.144851 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6ef671fe-3cf3-42ed-9658-474b58a8bbc7 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:50.144851 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6ef671fe-3cf3-42ed-9658-474b58a8bbc7 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:50.144851 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6ef671fe-3cf3-42ed-9658-474b58a8bbc7 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:50.144851 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6ef671fe-3cf3-42ed-9658-474b58a8bbc7 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:50.319011 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-6ef671fe-3cf3-42ed-9658-474b58a8bbc7 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:50.326825 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-6ef671fe-3cf3-42ed-9658-474b58a8bbc7 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1363 microversion: 2.1 time: 0.208911 Aug 31 12:59:50.327388 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 74/133] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:50 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:51.136374 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-218a9212-f8e6-46b9-924f-006a117a937b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:51.136978 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-218a9212-f8e6-46b9-924f-006a117a937b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:51.143844 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-218a9212-f8e6-46b9-924f-006a117a937b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:51.144384 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-218a9212-f8e6-46b9-924f-006a117a937b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:51.144822 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-218a9212-f8e6-46b9-924f-006a117a937b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:51.147855 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-218a9212-f8e6-46b9-924f-006a117a937b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:51.147855 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-218a9212-f8e6-46b9-924f-006a117a937b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:51.147855 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-218a9212-f8e6-46b9-924f-006a117a937b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:51.156037 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-e7cf33be-a489-4653-a935-6ef5331f2395 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:51.157418 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-e7cf33be-a489-4653-a935-6ef5331f2395 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:51.165205 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e7cf33be-a489-4653-a935-6ef5331f2395 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:51.165754 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e7cf33be-a489-4653-a935-6ef5331f2395 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:51.166252 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e7cf33be-a489-4653-a935-6ef5331f2395 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:51.167162 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e7cf33be-a489-4653-a935-6ef5331f2395 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:51.167697 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e7cf33be-a489-4653-a935-6ef5331f2395 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:51.168459 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e7cf33be-a489-4653-a935-6ef5331f2395 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:51.375029 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-218a9212-f8e6-46b9-924f-006a117a937b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:51.380354 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-e7cf33be-a489-4653-a935-6ef5331f2395 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63adaf56e417cba603f908a8e451c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0eff3111a5847a68620fce8060df208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:51.386495 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-218a9212-f8e6-46b9-924f-006a117a937b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1321 microversion: 2.1 time: 0.252486 Aug 31 12:59:51.388003 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 60/134] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:51 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1321 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:51.403424 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-e7cf33be-a489-4653-a935-6ef5331f2395 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 200 len: 1315 microversion: 2.1 time: 0.255136 Aug 31 12:59:51.403940 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-235131f9-15c0-4c88-bab4-3609835f0c31 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:51.404553 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-235131f9-15c0-4c88-bab4-3609835f0c31 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:51.408010 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 75/135] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:51 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:51.419447 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-235131f9-15c0-4c88-bab4-3609835f0c31 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:51.420091 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-235131f9-15c0-4c88-bab4-3609835f0c31 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:51.420601 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-235131f9-15c0-4c88-bab4-3609835f0c31 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:51.421522 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-235131f9-15c0-4c88-bab4-3609835f0c31 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:51.422118 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-235131f9-15c0-4c88-bab4-3609835f0c31 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:51.422557 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-235131f9-15c0-4c88-bab4-3609835f0c31 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:51.561505 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-235131f9-15c0-4c88-bab4-3609835f0c31 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:51.571291 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-235131f9-15c0-4c88-bab4-3609835f0c31 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1363 microversion: 2.1 time: 0.182209 Aug 31 12:59:51.571922 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 61/136] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:51 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:52.408498 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-bbf64cf8-2eda-41c2-8b72-3fc4fa9e902c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:52.410812 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-bbf64cf8-2eda-41c2-8b72-3fc4fa9e902c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:52.422780 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bbf64cf8-2eda-41c2-8b72-3fc4fa9e902c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:52.423265 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bbf64cf8-2eda-41c2-8b72-3fc4fa9e902c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:52.428645 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-85839bd2-b0e1-4229-b1a7-f747d5ea09a9 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:52.429912 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-85839bd2-b0e1-4229-b1a7-f747d5ea09a9 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:52.433731 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bbf64cf8-2eda-41c2-8b72-3fc4fa9e902c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:52.436476 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bbf64cf8-2eda-41c2-8b72-3fc4fa9e902c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:52.436943 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bbf64cf8-2eda-41c2-8b72-3fc4fa9e902c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:52.438810 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bbf64cf8-2eda-41c2-8b72-3fc4fa9e902c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:52.440233 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-85839bd2-b0e1-4229-b1a7-f747d5ea09a9 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:52.441840 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-85839bd2-b0e1-4229-b1a7-f747d5ea09a9 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:52.442256 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-85839bd2-b0e1-4229-b1a7-f747d5ea09a9 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:52.444375 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-85839bd2-b0e1-4229-b1a7-f747d5ea09a9 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:52.444982 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-85839bd2-b0e1-4229-b1a7-f747d5ea09a9 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:52.446116 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-85839bd2-b0e1-4229-b1a7-f747d5ea09a9 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:52.995218 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-bbf64cf8-2eda-41c2-8b72-3fc4fa9e902c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:53.001189 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-85839bd2-b0e1-4229-b1a7-f747d5ea09a9 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63adaf56e417cba603f908a8e451c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0eff3111a5847a68620fce8060df208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:53.008793 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-bbf64cf8-2eda-41c2-8b72-3fc4fa9e902c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1321 microversion: 2.1 time: 0.602525 Aug 31 12:59:53.024243 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 76/137] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:52 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1321 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:53.024243 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-e6e6dd0f-2ad7-4817-a913-b606666f027e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:53.024243 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-e6e6dd0f-2ad7-4817-a913-b606666f027e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:53.024243 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e6e6dd0f-2ad7-4817-a913-b606666f027e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:53.024243 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e6e6dd0f-2ad7-4817-a913-b606666f027e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:53.024887 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e6e6dd0f-2ad7-4817-a913-b606666f027e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:53.024887 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e6e6dd0f-2ad7-4817-a913-b606666f027e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:53.024887 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e6e6dd0f-2ad7-4817-a913-b606666f027e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:53.024887 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e6e6dd0f-2ad7-4817-a913-b606666f027e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:53.027309 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-85839bd2-b0e1-4229-b1a7-f747d5ea09a9 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 200 len: 1315 microversion: 2.1 time: 0.602395 Aug 31 12:59:53.038726 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 62/138] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:52 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 1315 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:53.281351 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-e6e6dd0f-2ad7-4817-a913-b606666f027e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:53.290943 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-e6e6dd0f-2ad7-4817-a913-b606666f027e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1363 microversion: 2.1 time: 0.279966 Aug 31 12:59:53.291792 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 77/139] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:53 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1363 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:54.038842 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-fb736640-6c81-4117-b576-708cf9e0e212 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:54.040583 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-fb736640-6c81-4117-b576-708cf9e0e212 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:54.050337 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-26390cb5-7f69-467b-9b24-9cfe7f8471bc tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:54.050936 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-26390cb5-7f69-467b-9b24-9cfe7f8471bc tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:54.059772 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-26390cb5-7f69-467b-9b24-9cfe7f8471bc tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:54.060199 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fb736640-6c81-4117-b576-708cf9e0e212 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:54.060848 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fb736640-6c81-4117-b576-708cf9e0e212 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:54.061849 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-26390cb5-7f69-467b-9b24-9cfe7f8471bc tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:54.062432 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fb736640-6c81-4117-b576-708cf9e0e212 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:54.063018 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-26390cb5-7f69-467b-9b24-9cfe7f8471bc tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:54.065164 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-26390cb5-7f69-467b-9b24-9cfe7f8471bc tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:54.065824 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fb736640-6c81-4117-b576-708cf9e0e212 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:54.066476 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-26390cb5-7f69-467b-9b24-9cfe7f8471bc tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:54.067147 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fb736640-6c81-4117-b576-708cf9e0e212 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:54.067731 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-26390cb5-7f69-467b-9b24-9cfe7f8471bc tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:54.068435 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fb736640-6c81-4117-b576-708cf9e0e212 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:54.383333 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-26390cb5-7f69-467b-9b24-9cfe7f8471bc tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63adaf56e417cba603f908a8e451c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0eff3111a5847a68620fce8060df208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:54.392280 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-26390cb5-7f69-467b-9b24-9cfe7f8471bc tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 200 len: 1315 microversion: 2.1 time: 0.345815 Aug 31 12:59:54.393315 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 78/140] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:54 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 1315 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:59:54.398472 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-4d28487d-0d07-48e5-a159-14af03c8dd77 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:54.399177 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-4d28487d-0d07-48e5-a159-14af03c8dd77 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:54.405544 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4d28487d-0d07-48e5-a159-14af03c8dd77 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:54.407163 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4d28487d-0d07-48e5-a159-14af03c8dd77 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:54.407835 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4d28487d-0d07-48e5-a159-14af03c8dd77 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:54.409319 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4d28487d-0d07-48e5-a159-14af03c8dd77 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:54.409990 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4d28487d-0d07-48e5-a159-14af03c8dd77 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:54.410620 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4d28487d-0d07-48e5-a159-14af03c8dd77 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:54.422828 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-fb736640-6c81-4117-b576-708cf9e0e212 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:54.434328 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-fb736640-6c81-4117-b576-708cf9e0e212 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1321 microversion: 2.1 time: 0.401397 Aug 31 12:59:54.434930 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 63/141] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:54 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1321 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:54.682656 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-4d28487d-0d07-48e5-a159-14af03c8dd77 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:54.691069 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-4d28487d-0d07-48e5-a159-14af03c8dd77 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1363 microversion: 2.1 time: 0.296246 Aug 31 12:59:54.691867 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 79/142] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:54 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1363 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:55.418679 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-9699c024-7f29-40f7-bda1-796cb505d991 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:55.419209 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-9699c024-7f29-40f7-bda1-796cb505d991 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:55.431996 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9699c024-7f29-40f7-bda1-796cb505d991 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:55.432927 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9699c024-7f29-40f7-bda1-796cb505d991 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:55.433691 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9699c024-7f29-40f7-bda1-796cb505d991 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:55.434505 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9699c024-7f29-40f7-bda1-796cb505d991 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:55.434948 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9699c024-7f29-40f7-bda1-796cb505d991 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:55.435659 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9699c024-7f29-40f7-bda1-796cb505d991 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:55.455037 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-2472bab6-944a-431c-bda1-aeb51cb13afe tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:55.455647 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-2472bab6-944a-431c-bda1-aeb51cb13afe tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:55.466843 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2472bab6-944a-431c-bda1-aeb51cb13afe tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:55.467343 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2472bab6-944a-431c-bda1-aeb51cb13afe tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:55.467884 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2472bab6-944a-431c-bda1-aeb51cb13afe tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:55.468626 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2472bab6-944a-431c-bda1-aeb51cb13afe tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:55.469075 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2472bab6-944a-431c-bda1-aeb51cb13afe tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:55.469492 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2472bab6-944a-431c-bda1-aeb51cb13afe tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:55.773143 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-9699c024-7f29-40f7-bda1-796cb505d991 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63adaf56e417cba603f908a8e451c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0eff3111a5847a68620fce8060df208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:55.788380 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-9699c024-7f29-40f7-bda1-796cb505d991 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 200 len: 1315 microversion: 2.1 time: 0.374029 Aug 31 12:59:55.790646 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 64/143] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:55 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 1315 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:55.802268 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-2472bab6-944a-431c-bda1-aeb51cb13afe tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:55.804312 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-59851131-63ff-4542-ad75-c029461e2c4d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:55.806689 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-59851131-63ff-4542-ad75-c029461e2c4d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:55.820430 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-59851131-63ff-4542-ad75-c029461e2c4d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:55.823065 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-59851131-63ff-4542-ad75-c029461e2c4d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:55.824467 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-59851131-63ff-4542-ad75-c029461e2c4d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:55.827789 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-2472bab6-944a-431c-bda1-aeb51cb13afe tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1321 microversion: 2.1 time: 0.376992 Aug 31 12:59:55.828935 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-59851131-63ff-4542-ad75-c029461e2c4d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:55.829493 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-59851131-63ff-4542-ad75-c029461e2c4d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:55.830013 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-59851131-63ff-4542-ad75-c029461e2c4d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:55.832024 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 80/144] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:55 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1321 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:59:56.093665 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-59851131-63ff-4542-ad75-c029461e2c4d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:56.102383 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-59851131-63ff-4542-ad75-c029461e2c4d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1363 microversion: 2.1 time: 0.310396 Aug 31 12:59:56.108105 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 65/145] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:55 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1363 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:56.810942 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-4c3a8af9-a4ea-4ab7-9918-96530b1f0196 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:56.812139 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-4c3a8af9-a4ea-4ab7-9918-96530b1f0196 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:56.822951 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4c3a8af9-a4ea-4ab7-9918-96530b1f0196 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:56.824209 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4c3a8af9-a4ea-4ab7-9918-96530b1f0196 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:56.836429 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4c3a8af9-a4ea-4ab7-9918-96530b1f0196 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:56.838734 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4c3a8af9-a4ea-4ab7-9918-96530b1f0196 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:56.840214 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4c3a8af9-a4ea-4ab7-9918-96530b1f0196 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:56.840986 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4c3a8af9-a4ea-4ab7-9918-96530b1f0196 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:56.854096 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-26a4c50a-7f12-4e50-a38a-a01884d44c3d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:56.854915 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-26a4c50a-7f12-4e50-a38a-a01884d44c3d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:56.864174 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-26a4c50a-7f12-4e50-a38a-a01884d44c3d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:56.864664 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-26a4c50a-7f12-4e50-a38a-a01884d44c3d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:56.865095 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-26a4c50a-7f12-4e50-a38a-a01884d44c3d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:56.865796 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-26a4c50a-7f12-4e50-a38a-a01884d44c3d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:56.866236 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-26a4c50a-7f12-4e50-a38a-a01884d44c3d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:56.866638 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-26a4c50a-7f12-4e50-a38a-a01884d44c3d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:57.412979 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-26a4c50a-7f12-4e50-a38a-a01884d44c3d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:57.423546 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-4c3a8af9-a4ea-4ab7-9918-96530b1f0196 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63adaf56e417cba603f908a8e451c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0eff3111a5847a68620fce8060df208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:57.429445 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-26a4c50a-7f12-4e50-a38a-a01884d44c3d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1321 microversion: 2.1 time: 0.578642 Aug 31 12:59:57.430805 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 66/146] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:56 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1321 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:57.433139 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-4c3a8af9-a4ea-4ab7-9918-96530b1f0196 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 200 len: 1315 microversion: 2.1 time: 0.626342 Aug 31 12:59:57.438160 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 81/147] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:56 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 1315 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:57.440601 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-55b72989-69ba-4e63-a34f-a075785e3123 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:57.441214 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-55b72989-69ba-4e63-a34f-a075785e3123 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:57.460402 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-55b72989-69ba-4e63-a34f-a075785e3123 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:57.460951 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-55b72989-69ba-4e63-a34f-a075785e3123 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:57.468496 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-55b72989-69ba-4e63-a34f-a075785e3123 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:57.469306 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-55b72989-69ba-4e63-a34f-a075785e3123 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:57.469782 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-55b72989-69ba-4e63-a34f-a075785e3123 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:57.470214 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-55b72989-69ba-4e63-a34f-a075785e3123 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:57.661849 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-55b72989-69ba-4e63-a34f-a075785e3123 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:57.679675 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-55b72989-69ba-4e63-a34f-a075785e3123 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1363 microversion: 2.1 time: 0.246228 Aug 31 12:59:57.691841 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 67/148] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:57 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1363 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:57.826414 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-22e949d5-c6d2-4964-9500-e9fa4e94b1a9 req-02c06c35-76f7-4bcb-93d9-eca8ee0d0f8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de7a8eee-34d7-45c9-bbc0-5b9f954776e7", "name": "network-vif-plugged", "status": "completed", "tag": "f29a1e36-6b6c-465b-971e-9130133909df"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:59:57.843782 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-22e949d5-c6d2-4964-9500-e9fa4e94b1a9 req-02c06c35-76f7-4bcb-93d9-eca8ee0d0f8f service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:57.845624 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-22e949d5-c6d2-4964-9500-e9fa4e94b1a9 req-02c06c35-76f7-4bcb-93d9-eca8ee0d0f8f service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:57.846325 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-22e949d5-c6d2-4964-9500-e9fa4e94b1a9 req-02c06c35-76f7-4bcb-93d9-eca8ee0d0f8f service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:57.863425 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-22e949d5-c6d2-4964-9500-e9fa4e94b1a9 req-02c06c35-76f7-4bcb-93d9-eca8ee0d0f8f service nova] Creating event network-vif-plugged:f29a1e36-6b6c-465b-971e-9130133909df for instance de7a8eee-34d7-45c9-bbc0-5b9f954776e7 on hv-cinder-85442 Aug 31 12:59:57.868980 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-22e949d5-c6d2-4964-9500-e9fa4e94b1a9 req-02c06c35-76f7-4bcb-93d9-eca8ee0d0f8f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046982 Aug 31 12:59:57.869842 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 82/149] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 12:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:59:58.471384 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-9755370c-d5ae-4f48-a9ca-ab511fb688f8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:58.472400 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-9755370c-d5ae-4f48-a9ca-ab511fb688f8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:58.474180 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b3033361-3bb4-4f57-a85d-8ec40d3e0211 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:58.474888 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b3033361-3bb4-4f57-a85d-8ec40d3e0211 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:58.482804 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b3033361-3bb4-4f57-a85d-8ec40d3e0211 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:58.483999 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b3033361-3bb4-4f57-a85d-8ec40d3e0211 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:58.484625 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b3033361-3bb4-4f57-a85d-8ec40d3e0211 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:58.485524 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b3033361-3bb4-4f57-a85d-8ec40d3e0211 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:58.486161 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b3033361-3bb4-4f57-a85d-8ec40d3e0211 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:58.486974 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b3033361-3bb4-4f57-a85d-8ec40d3e0211 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:58.498482 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9755370c-d5ae-4f48-a9ca-ab511fb688f8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:58.500971 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9755370c-d5ae-4f48-a9ca-ab511fb688f8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:58.501664 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9755370c-d5ae-4f48-a9ca-ab511fb688f8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:58.502822 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9755370c-d5ae-4f48-a9ca-ab511fb688f8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:58.506239 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9755370c-d5ae-4f48-a9ca-ab511fb688f8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:58.506870 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9755370c-d5ae-4f48-a9ca-ab511fb688f8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:58.997821 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-b3033361-3bb4-4f57-a85d-8ec40d3e0211 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63adaf56e417cba603f908a8e451c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0eff3111a5847a68620fce8060df208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:59.034136 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b3033361-3bb4-4f57-a85d-8ec40d3e0211 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 200 len: 1315 microversion: 2.1 time: 0.563851 Aug 31 12:59:59.034761 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 68/150] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:58 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 1315 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:59.056258 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-f686c7e6-9d4d-4075-a8e9-3f77763654bd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:59.056873 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-f686c7e6-9d4d-4075-a8e9-3f77763654bd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:59:59.084871 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f686c7e6-9d4d-4075-a8e9-3f77763654bd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:59.085672 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f686c7e6-9d4d-4075-a8e9-3f77763654bd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:59.086258 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f686c7e6-9d4d-4075-a8e9-3f77763654bd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:59.087107 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f686c7e6-9d4d-4075-a8e9-3f77763654bd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:59:59.087783 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f686c7e6-9d4d-4075-a8e9-3f77763654bd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:59:59.088376 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f686c7e6-9d4d-4075-a8e9-3f77763654bd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:59:59.149748 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-9755370c-d5ae-4f48-a9ca-ab511fb688f8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:59.164971 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-9755370c-d5ae-4f48-a9ca-ab511fb688f8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1321 microversion: 2.1 time: 0.702732 Aug 31 12:59:59.165597 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 83/151] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:58 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1321 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:59:59.385970 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-f686c7e6-9d4d-4075-a8e9-3f77763654bd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:59:59.406145 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-f686c7e6-9d4d-4075-a8e9-3f77763654bd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1363 microversion: 2.1 time: 0.348215 Aug 31 12:59:59.407337 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 69/152] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 12:59:59 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1363 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:00.056004 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-584f99bd-42fb-4c4f-b908-f20e9d79a1a4 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:00.056771 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-584f99bd-42fb-4c4f-b908-f20e9d79a1a4 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:00.068003 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_api:SELECT=76 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:00.071156 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-584f99bd-42fb-4c4f-b908-f20e9d79a1a4 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:00.072575 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-584f99bd-42fb-4c4f-b908-f20e9d79a1a4 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:00.073980 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-584f99bd-42fb-4c4f-b908-f20e9d79a1a4 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:00.075002 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-584f99bd-42fb-4c4f-b908-f20e9d79a1a4 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:00.076087 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-584f99bd-42fb-4c4f-b908-f20e9d79a1a4 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:00.081028 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-584f99bd-42fb-4c4f-b908-f20e9d79a1a4 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:00.192117 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-dc5cedd8-4e25-409b-97b7-273653d2218b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:00.193666 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-dc5cedd8-4e25-409b-97b7-273653d2218b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:00.203436 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dc5cedd8-4e25-409b-97b7-273653d2218b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:00.204342 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dc5cedd8-4e25-409b-97b7-273653d2218b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:00.205407 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dc5cedd8-4e25-409b-97b7-273653d2218b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:00.206544 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dc5cedd8-4e25-409b-97b7-273653d2218b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:00.208127 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dc5cedd8-4e25-409b-97b7-273653d2218b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:00.208839 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dc5cedd8-4e25-409b-97b7-273653d2218b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:00.632381 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-584f99bd-42fb-4c4f-b908-f20e9d79a1a4 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63adaf56e417cba603f908a8e451c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0eff3111a5847a68620fce8060df208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:00.662500 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-584f99bd-42fb-4c4f-b908-f20e9d79a1a4 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 200 len: 1315 microversion: 2.1 time: 0.611350 Aug 31 13:00:00.663763 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 84/153] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:00 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 1315 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:00.685249 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-af4e7909-8379-46ed-a257-eb9d5a29fe60 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:00.686343 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-af4e7909-8379-46ed-a257-eb9d5a29fe60 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:00.695517 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-af4e7909-8379-46ed-a257-eb9d5a29fe60 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:00.696486 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-af4e7909-8379-46ed-a257-eb9d5a29fe60 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:00.697145 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-af4e7909-8379-46ed-a257-eb9d5a29fe60 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:00.698057 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-af4e7909-8379-46ed-a257-eb9d5a29fe60 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:00.698719 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-af4e7909-8379-46ed-a257-eb9d5a29fe60 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:00.727118 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-af4e7909-8379-46ed-a257-eb9d5a29fe60 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:00.788408 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-dc5cedd8-4e25-409b-97b7-273653d2218b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:00.797692 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-dc5cedd8-4e25-409b-97b7-273653d2218b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1321 microversion: 2.1 time: 0.611494 Aug 31 13:00:00.798442 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 70/154] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:00 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1321 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:01.424285 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-af4e7909-8379-46ed-a257-eb9d5a29fe60 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:01.435516 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-af4e7909-8379-46ed-a257-eb9d5a29fe60 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1363 microversion: 2.1 time: 0.769839 Aug 31 13:00:01.439347 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 85/155] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:00 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1363 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:01.690170 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-f759c198-f031-41ba-b194-e9dfbac4b1a5 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:01.691617 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-f759c198-f031-41ba-b194-e9dfbac4b1a5 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:01.703842 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f759c198-f031-41ba-b194-e9dfbac4b1a5 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:01.705265 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f759c198-f031-41ba-b194-e9dfbac4b1a5 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:01.705905 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f759c198-f031-41ba-b194-e9dfbac4b1a5 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:01.710007 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f759c198-f031-41ba-b194-e9dfbac4b1a5 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:01.713757 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f759c198-f031-41ba-b194-e9dfbac4b1a5 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:01.715633 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f759c198-f031-41ba-b194-e9dfbac4b1a5 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:01.821427 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-c33bb823-89a9-48fb-b170-2091483502bc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:01.822030 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-c33bb823-89a9-48fb-b170-2091483502bc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:01.834160 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c33bb823-89a9-48fb-b170-2091483502bc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:01.837013 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c33bb823-89a9-48fb-b170-2091483502bc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:01.838068 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c33bb823-89a9-48fb-b170-2091483502bc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:01.841263 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c33bb823-89a9-48fb-b170-2091483502bc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:01.843953 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c33bb823-89a9-48fb-b170-2091483502bc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:01.846130 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c33bb823-89a9-48fb-b170-2091483502bc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:01.906355 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell1:SELECT=100 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:02.689667 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-f759c198-f031-41ba-b194-e9dfbac4b1a5 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63adaf56e417cba603f908a8e451c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0eff3111a5847a68620fce8060df208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:02.714916 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-f759c198-f031-41ba-b194-e9dfbac4b1a5 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 200 len: 1315 microversion: 2.1 time: 1.023243 Aug 31 13:00:02.727917 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 71/156] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:01 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 1315 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:02.727917 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-0466f43e-97b9-4213-af3e-ca20d475b670 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:02.727917 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-0466f43e-97b9-4213-af3e-ca20d475b670 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:02.731545 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-c33bb823-89a9-48fb-b170-2091483502bc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:02.746230 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-c33bb823-89a9-48fb-b170-2091483502bc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1321 microversion: 2.1 time: 0.929068 Aug 31 13:00:02.748722 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 86/157] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:01 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1321 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:00:02.751097 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0466f43e-97b9-4213-af3e-ca20d475b670 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:02.751771 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0466f43e-97b9-4213-af3e-ca20d475b670 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:02.752421 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0466f43e-97b9-4213-af3e-ca20d475b670 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:02.753178 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0466f43e-97b9-4213-af3e-ca20d475b670 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:02.753628 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0466f43e-97b9-4213-af3e-ca20d475b670 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:02.754048 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0466f43e-97b9-4213-af3e-ca20d475b670 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:03.099514 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-0466f43e-97b9-4213-af3e-ca20d475b670 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:03.107899 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-0466f43e-97b9-4213-af3e-ca20d475b670 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1363 microversion: 2.1 time: 0.391200 Aug 31 13:00:03.111250 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 72/158] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:02 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1363 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:03.735757 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-77ceaa9e-68c0-4f91-bc74-65e3dddedc6a tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:03.736420 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-77ceaa9e-68c0-4f91-bc74-65e3dddedc6a tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:03.745791 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-77ceaa9e-68c0-4f91-bc74-65e3dddedc6a tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:03.746278 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-77ceaa9e-68c0-4f91-bc74-65e3dddedc6a tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:03.746715 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-77ceaa9e-68c0-4f91-bc74-65e3dddedc6a tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:03.747929 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-77ceaa9e-68c0-4f91-bc74-65e3dddedc6a tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:03.748647 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-77ceaa9e-68c0-4f91-bc74-65e3dddedc6a tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:03.750846 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-77ceaa9e-68c0-4f91-bc74-65e3dddedc6a tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:03.786951 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-0afe14f6-ceaa-4327-ad0f-059ca08feae7 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:03.787558 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-0afe14f6-ceaa-4327-ad0f-059ca08feae7 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:03.799298 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0afe14f6-ceaa-4327-ad0f-059ca08feae7 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:03.800564 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0afe14f6-ceaa-4327-ad0f-059ca08feae7 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:03.801573 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0afe14f6-ceaa-4327-ad0f-059ca08feae7 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:03.803769 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0afe14f6-ceaa-4327-ad0f-059ca08feae7 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:03.804908 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0afe14f6-ceaa-4327-ad0f-059ca08feae7 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:03.806319 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0afe14f6-ceaa-4327-ad0f-059ca08feae7 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:04.047291 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-77ceaa9e-68c0-4f91-bc74-65e3dddedc6a tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63adaf56e417cba603f908a8e451c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0eff3111a5847a68620fce8060df208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:04.057296 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-77ceaa9e-68c0-4f91-bc74-65e3dddedc6a tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 200 len: 1315 microversion: 2.1 time: 0.325870 Aug 31 13:00:04.072386 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 87/159] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:03 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:04.081555 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-0afe14f6-ceaa-4327-ad0f-059ca08feae7 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:04.091250 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-0afe14f6-ceaa-4327-ad0f-059ca08feae7 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1321 microversion: 2.1 time: 0.308477 Aug 31 13:00:04.092179 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 73/160] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:03 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1321 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:04.130431 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-3ec19eca-9b42-497b-8ba1-9bb7ad285dc6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:04.131049 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-3ec19eca-9b42-497b-8ba1-9bb7ad285dc6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:04.140026 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3ec19eca-9b42-497b-8ba1-9bb7ad285dc6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:04.140642 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3ec19eca-9b42-497b-8ba1-9bb7ad285dc6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:04.141072 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3ec19eca-9b42-497b-8ba1-9bb7ad285dc6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:04.141759 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3ec19eca-9b42-497b-8ba1-9bb7ad285dc6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:04.142245 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3ec19eca-9b42-497b-8ba1-9bb7ad285dc6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:04.142631 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3ec19eca-9b42-497b-8ba1-9bb7ad285dc6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:04.338639 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-3ec19eca-9b42-497b-8ba1-9bb7ad285dc6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:04.348817 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-3ec19eca-9b42-497b-8ba1-9bb7ad285dc6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1363 microversion: 2.1 time: 0.221596 Aug 31 13:00:04.349401 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 88/161] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:04 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:05.079046 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e631ee77-9ca4-4bd6-b0cd-0272e4a65049 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:05.079800 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e631ee77-9ca4-4bd6-b0cd-0272e4a65049 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:05.089157 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e631ee77-9ca4-4bd6-b0cd-0272e4a65049 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:05.090947 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e631ee77-9ca4-4bd6-b0cd-0272e4a65049 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:05.093369 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e631ee77-9ca4-4bd6-b0cd-0272e4a65049 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:05.094811 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e631ee77-9ca4-4bd6-b0cd-0272e4a65049 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:05.097604 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e631ee77-9ca4-4bd6-b0cd-0272e4a65049 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:05.098443 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e631ee77-9ca4-4bd6-b0cd-0272e4a65049 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:05.115741 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-1ee702ab-b7e7-41d3-9db5-672c61d30e4c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:05.116561 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-1ee702ab-b7e7-41d3-9db5-672c61d30e4c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:05.126835 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1ee702ab-b7e7-41d3-9db5-672c61d30e4c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:05.129360 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1ee702ab-b7e7-41d3-9db5-672c61d30e4c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:05.131865 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1ee702ab-b7e7-41d3-9db5-672c61d30e4c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:05.133464 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1ee702ab-b7e7-41d3-9db5-672c61d30e4c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:05.134882 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1ee702ab-b7e7-41d3-9db5-672c61d30e4c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:05.136123 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1ee702ab-b7e7-41d3-9db5-672c61d30e4c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:05.429708 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e631ee77-9ca4-4bd6-b0cd-0272e4a65049 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63adaf56e417cba603f908a8e451c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0eff3111a5847a68620fce8060df208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:05.447786 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e631ee77-9ca4-4bd6-b0cd-0272e4a65049 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 200 len: 1315 microversion: 2.1 time: 0.372738 Aug 31 13:00:05.450131 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 74/162] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:05 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 1315 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:05.461235 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-8d475ebb-3120-4c86-8ddd-7d06dc22ec3e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:05.461847 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-8d475ebb-3120-4c86-8ddd-7d06dc22ec3e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:05.472048 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-1ee702ab-b7e7-41d3-9db5-672c61d30e4c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:05.480104 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8d475ebb-3120-4c86-8ddd-7d06dc22ec3e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:05.481803 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8d475ebb-3120-4c86-8ddd-7d06dc22ec3e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:05.483404 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8d475ebb-3120-4c86-8ddd-7d06dc22ec3e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:05.484937 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8d475ebb-3120-4c86-8ddd-7d06dc22ec3e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:05.486506 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-1ee702ab-b7e7-41d3-9db5-672c61d30e4c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1321 microversion: 2.1 time: 0.375563 Aug 31 13:00:05.487188 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8d475ebb-3120-4c86-8ddd-7d06dc22ec3e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:05.491594 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 89/163] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:05 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1321 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:05.492415 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8d475ebb-3120-4c86-8ddd-7d06dc22ec3e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:05.540017 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=100 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:05.688332 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-8d475ebb-3120-4c86-8ddd-7d06dc22ec3e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:05.700728 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-8d475ebb-3120-4c86-8ddd-7d06dc22ec3e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1363 microversion: 2.1 time: 0.249226 Aug 31 13:00:05.701688 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 75/164] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:05 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1363 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:05.966451 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-b2578e27-9a93-4c75-a557-3785dac48860 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Action: 'create', calling method: .version_select at 0x7f19516d39d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-602751871", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBixAse9BMZyyoJyMHZyaIPLeDbzqN3W1aa90WErBcQ9OdA5cwUkXwo+BQdDmycAJKLoe9aq+LvF3nzFRGXd9yDBaEh9TTl/yZ8NTxdWg4Yjw+fiwQ8vebJn3UOGfeXaYQ=="}} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:00:05.989421 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.quota [None req-b2578e27-9a93-4c75-a557-3785dac48860 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Getting quotas for project 3859db006a384cd9b5ba39ca7e6fb922. Resources: {'key_pairs'} {{(pid=120704) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 13:00:05.994381 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.quota [None req-b2578e27-9a93-4c75-a557-3785dac48860 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Getting quotas for user a961ae2bcbe24018befc9b9a9e6d288e and project 3859db006a384cd9b5ba39ca7e6fb922. Resources: {'key_pairs'} {{(pid=120704) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 13:00:06.020652 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-b2578e27-9a93-4c75-a557-3785dac48860 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.270645 Aug 31 13:00:06.021353 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 90/165] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 31 13:00:05 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:00:06.468754 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-7858a290-53ed-4538-998e-d144c13f16ad tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:06.469355 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-7858a290-53ed-4538-998e-d144c13f16ad tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:06.475640 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7858a290-53ed-4538-998e-d144c13f16ad tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:06.476239 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7858a290-53ed-4538-998e-d144c13f16ad tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:06.476686 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7858a290-53ed-4538-998e-d144c13f16ad tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:06.477354 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7858a290-53ed-4538-998e-d144c13f16ad tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:06.477966 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7858a290-53ed-4538-998e-d144c13f16ad tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:06.478386 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7858a290-53ed-4538-998e-d144c13f16ad tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:06.508697 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-b39867ed-65c5-4044-a712-2fa3bca25fe6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:06.509319 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-b39867ed-65c5-4044-a712-2fa3bca25fe6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:06.535468 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b39867ed-65c5-4044-a712-2fa3bca25fe6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:06.536801 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b39867ed-65c5-4044-a712-2fa3bca25fe6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:06.537434 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b39867ed-65c5-4044-a712-2fa3bca25fe6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:06.541329 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b39867ed-65c5-4044-a712-2fa3bca25fe6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:06.541977 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b39867ed-65c5-4044-a712-2fa3bca25fe6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:06.542769 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b39867ed-65c5-4044-a712-2fa3bca25fe6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:06.769093 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-7858a290-53ed-4538-998e-d144c13f16ad tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63adaf56e417cba603f908a8e451c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0eff3111a5847a68620fce8060df208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:06.782248 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-7858a290-53ed-4538-998e-d144c13f16ad tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 200 len: 1315 microversion: 2.1 time: 0.317235 Aug 31 13:00:06.782850 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 76/166] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:06 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:06.794999 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3db8fefd-ff23-47f1-a344-f8864919879a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:06.796343 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-3db8fefd-ff23-47f1-a344-f8864919879a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:06.803415 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-b39867ed-65c5-4044-a712-2fa3bca25fe6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:06.811219 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-b39867ed-65c5-4044-a712-2fa3bca25fe6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1321 microversion: 2.1 time: 0.306936 Aug 31 13:00:06.813587 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 91/167] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:06 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1321 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:00:06.828401 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3db8fefd-ff23-47f1-a344-f8864919879a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:06.829051 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3db8fefd-ff23-47f1-a344-f8864919879a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:06.829545 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3db8fefd-ff23-47f1-a344-f8864919879a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:06.830928 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3db8fefd-ff23-47f1-a344-f8864919879a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:06.831570 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3db8fefd-ff23-47f1-a344-f8864919879a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:06.832263 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3db8fefd-ff23-47f1-a344-f8864919879a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:07.069449 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-3db8fefd-ff23-47f1-a344-f8864919879a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:07.078213 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-3db8fefd-ff23-47f1-a344-f8864919879a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1363 microversion: 2.1 time: 0.293065 Aug 31 13:00:07.078793 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 77/168] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:06 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1363 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:07.823237 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-18091795-522d-4895-8356-1f98b8c6de3f tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:07.823237 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-18091795-522d-4895-8356-1f98b8c6de3f tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:07.826569 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-18091795-522d-4895-8356-1f98b8c6de3f tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:07.827194 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-18091795-522d-4895-8356-1f98b8c6de3f tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:07.830092 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-18091795-522d-4895-8356-1f98b8c6de3f tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:07.830848 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-18091795-522d-4895-8356-1f98b8c6de3f tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:07.831313 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-18091795-522d-4895-8356-1f98b8c6de3f tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:07.832862 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-18091795-522d-4895-8356-1f98b8c6de3f tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:07.835956 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-49488df4-6725-4794-b235-0a6546c1dba2 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:07.836585 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-49488df4-6725-4794-b235-0a6546c1dba2 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:07.848800 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-49488df4-6725-4794-b235-0a6546c1dba2 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:07.852405 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-49488df4-6725-4794-b235-0a6546c1dba2 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:07.852976 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-49488df4-6725-4794-b235-0a6546c1dba2 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:07.856527 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-49488df4-6725-4794-b235-0a6546c1dba2 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:07.856995 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-49488df4-6725-4794-b235-0a6546c1dba2 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:07.857425 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-49488df4-6725-4794-b235-0a6546c1dba2 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:08.088474 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-18091795-522d-4895-8356-1f98b8c6de3f tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63adaf56e417cba603f908a8e451c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0eff3111a5847a68620fce8060df208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:08.099319 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-18091795-522d-4895-8356-1f98b8c6de3f tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 200 len: 1315 microversion: 2.1 time: 0.298038 Aug 31 13:00:08.107327 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-49488df4-6725-4794-b235-0a6546c1dba2 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:08.112673 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 92/169] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:07 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:08.118328 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-49488df4-6725-4794-b235-0a6546c1dba2 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1321 microversion: 2.1 time: 0.287281 Aug 31 13:00:08.119252 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 78/170] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:07 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1321 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:00:08.132328 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-af0da51f-6e8b-46be-b833-37ce33619e4d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:08.134442 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-af0da51f-6e8b-46be-b833-37ce33619e4d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:08.144583 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-af0da51f-6e8b-46be-b833-37ce33619e4d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:08.145077 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-af0da51f-6e8b-46be-b833-37ce33619e4d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:08.145510 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-af0da51f-6e8b-46be-b833-37ce33619e4d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:08.146929 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-af0da51f-6e8b-46be-b833-37ce33619e4d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:08.147595 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-af0da51f-6e8b-46be-b833-37ce33619e4d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:08.148547 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-af0da51f-6e8b-46be-b833-37ce33619e4d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:08.349678 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-af0da51f-6e8b-46be-b833-37ce33619e4d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:08.365031 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-af0da51f-6e8b-46be-b833-37ce33619e4d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1363 microversion: 2.1 time: 0.243772 Aug 31 13:00:08.365789 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 93/171] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:08 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1363 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:08.530925 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-6c8d8e71-e5c2-44eb-b5cd-4eae16ad0229 req-b0c1a145-49e9-4a3a-a5f1-08c88e1bb93e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f97b98c1-e7be-4c90-8c65-715135db482b", "name": "network-vif-plugged", "status": "completed", "tag": "02f6e7e8-3148-4cb2-917c-2e387bedf92c"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:00:08.547411 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=66 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:08.552406 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-6c8d8e71-e5c2-44eb-b5cd-4eae16ad0229 req-b0c1a145-49e9-4a3a-a5f1-08c88e1bb93e service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:08.552931 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-6c8d8e71-e5c2-44eb-b5cd-4eae16ad0229 req-b0c1a145-49e9-4a3a-a5f1-08c88e1bb93e service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:08.553414 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-6c8d8e71-e5c2-44eb-b5cd-4eae16ad0229 req-b0c1a145-49e9-4a3a-a5f1-08c88e1bb93e service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:08.589488 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-6c8d8e71-e5c2-44eb-b5cd-4eae16ad0229 req-b0c1a145-49e9-4a3a-a5f1-08c88e1bb93e service nova] Creating event network-vif-plugged:02f6e7e8-3148-4cb2-917c-2e387bedf92c for instance f97b98c1-e7be-4c90-8c65-715135db482b on hv-cinder-85442 Aug 31 13:00:08.621220 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-6c8d8e71-e5c2-44eb-b5cd-4eae16ad0229 req-b0c1a145-49e9-4a3a-a5f1-08c88e1bb93e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086111 Aug 31 13:00:08.621927 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 79/172] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:00:09.124849 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-9ebe18dd-1f4d-4744-b290-6f0096789703 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:09.126132 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-9ebe18dd-1f4d-4744-b290-6f0096789703 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:09.140569 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9ebe18dd-1f4d-4744-b290-6f0096789703 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:09.141624 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-4d6cb729-98ee-4891-81ca-0495d23547aa tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:09.142322 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-4d6cb729-98ee-4891-81ca-0495d23547aa tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:09.144440 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9ebe18dd-1f4d-4744-b290-6f0096789703 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:09.144877 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9ebe18dd-1f4d-4744-b290-6f0096789703 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:09.145611 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9ebe18dd-1f4d-4744-b290-6f0096789703 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:09.146204 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9ebe18dd-1f4d-4744-b290-6f0096789703 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:09.149237 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9ebe18dd-1f4d-4744-b290-6f0096789703 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:09.150440 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4d6cb729-98ee-4891-81ca-0495d23547aa tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:09.151088 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4d6cb729-98ee-4891-81ca-0495d23547aa tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:09.151536 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4d6cb729-98ee-4891-81ca-0495d23547aa tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:09.152245 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4d6cb729-98ee-4891-81ca-0495d23547aa tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:09.152687 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4d6cb729-98ee-4891-81ca-0495d23547aa tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:09.153108 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4d6cb729-98ee-4891-81ca-0495d23547aa tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:09.633767 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-4d6cb729-98ee-4891-81ca-0495d23547aa tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:09.644821 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-4d6cb729-98ee-4891-81ca-0495d23547aa tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1321 microversion: 2.1 time: 0.507539 Aug 31 13:00:09.645762 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 80/173] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:09 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1321 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:09.653550 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-4ae05469-cd44-4ab7-b093-79a7e116f31b tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:09.654361 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-4ae05469-cd44-4ab7-b093-79a7e116f31b tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:09.660650 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4ae05469-cd44-4ab7-b093-79a7e116f31b tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:09.661136 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4ae05469-cd44-4ab7-b093-79a7e116f31b tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:09.661564 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4ae05469-cd44-4ab7-b093-79a7e116f31b tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:09.662482 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4ae05469-cd44-4ab7-b093-79a7e116f31b tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:09.662925 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4ae05469-cd44-4ab7-b093-79a7e116f31b tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:09.663342 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4ae05469-cd44-4ab7-b093-79a7e116f31b tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:09.676519 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-9ebe18dd-1f4d-4744-b290-6f0096789703 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63adaf56e417cba603f908a8e451c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0eff3111a5847a68620fce8060df208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:09.687007 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-9ebe18dd-1f4d-4744-b290-6f0096789703 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 200 len: 1315 microversion: 2.1 time: 0.566840 Aug 31 13:00:09.687751 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 94/174] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:09 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 1315 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:09.830601 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-4ae05469-cd44-4ab7-b093-79a7e116f31b tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:09.841648 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-4ae05469-cd44-4ab7-b093-79a7e116f31b tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1363 microversion: 2.1 time: 0.194094 Aug 31 13:00:09.842519 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 81/175] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:09 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:10.675454 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-35d04897-12c8-476a-9c4d-6a092aee735e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:10.676086 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-35d04897-12c8-476a-9c4d-6a092aee735e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:10.683141 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-47cc45a5-ae9b-4611-87b8-0d3ccced970e req-12035abc-530e-4214-8b1d-10ab230a432c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48f08cc0-15cb-4884-960b-a96396a0d4bf", "name": "network-vif-plugged", "status": "completed", "tag": "d7daad8a-fae2-4a08-ba82-bc48fa334e9e"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:00:10.697653 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-35d04897-12c8-476a-9c4d-6a092aee735e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:10.698155 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-35d04897-12c8-476a-9c4d-6a092aee735e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:10.698669 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-35d04897-12c8-476a-9c4d-6a092aee735e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:10.699256 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-35d04897-12c8-476a-9c4d-6a092aee735e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:10.699690 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-35d04897-12c8-476a-9c4d-6a092aee735e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:10.700138 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-35d04897-12c8-476a-9c4d-6a092aee735e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:10.700789 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-47cc45a5-ae9b-4611-87b8-0d3ccced970e req-12035abc-530e-4214-8b1d-10ab230a432c service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:10.702012 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-47cc45a5-ae9b-4611-87b8-0d3ccced970e req-12035abc-530e-4214-8b1d-10ab230a432c service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:10.702855 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-47cc45a5-ae9b-4611-87b8-0d3ccced970e req-12035abc-530e-4214-8b1d-10ab230a432c service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:10.728207 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-47cc45a5-ae9b-4611-87b8-0d3ccced970e req-12035abc-530e-4214-8b1d-10ab230a432c service nova] Creating event network-vif-plugged:d7daad8a-fae2-4a08-ba82-bc48fa334e9e for instance 48f08cc0-15cb-4884-960b-a96396a0d4bf on hv-cinder-85442 Aug 31 13:00:10.750030 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-47cc45a5-ae9b-4611-87b8-0d3ccced970e req-12035abc-530e-4214-8b1d-10ab230a432c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078212 Aug 31 13:00:10.752185 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 95/176] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:00:10.767834 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-91a162d2-a3fd-4914-b68f-e5ef1b71770d tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:10.773422 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-91a162d2-a3fd-4914-b68f-e5ef1b71770d tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:10.787489 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-91a162d2-a3fd-4914-b68f-e5ef1b71770d tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:10.788962 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-91a162d2-a3fd-4914-b68f-e5ef1b71770d tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:10.791177 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-91a162d2-a3fd-4914-b68f-e5ef1b71770d tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:10.794924 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-91a162d2-a3fd-4914-b68f-e5ef1b71770d tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:10.795687 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-91a162d2-a3fd-4914-b68f-e5ef1b71770d tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:10.796291 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-91a162d2-a3fd-4914-b68f-e5ef1b71770d tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:11.002161 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-35d04897-12c8-476a-9c4d-6a092aee735e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:11.017779 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-35d04897-12c8-476a-9c4d-6a092aee735e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1516 microversion: 2.1 time: 0.346387 Aug 31 13:00:11.018841 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 82/177] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:10 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1516 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:11.025974 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-926d0da1-ec3f-4e45-a50e-4172424b5baf tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:11.026810 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-926d0da1-ec3f-4e45-a50e-4172424b5baf tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:11.035504 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-926d0da1-ec3f-4e45-a50e-4172424b5baf tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:11.036805 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-926d0da1-ec3f-4e45-a50e-4172424b5baf tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:11.037518 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-926d0da1-ec3f-4e45-a50e-4172424b5baf tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:11.039251 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-926d0da1-ec3f-4e45-a50e-4172424b5baf tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:11.040106 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-926d0da1-ec3f-4e45-a50e-4172424b5baf tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:11.040780 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-926d0da1-ec3f-4e45-a50e-4172424b5baf tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:11.102178 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-91a162d2-a3fd-4914-b68f-e5ef1b71770d tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63adaf56e417cba603f908a8e451c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0eff3111a5847a68620fce8060df208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:11.116362 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-91a162d2-a3fd-4914-b68f-e5ef1b71770d tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 200 len: 1501 microversion: 2.1 time: 0.357380 Aug 31 13:00:11.118478 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 96/178] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:10 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 1501 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:11.132043 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-b5abfda7-ab2d-4e58-8703-8dbd36f4ef46 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:00:11.136445 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-b5abfda7-ab2d-4e58-8703-8dbd36f4ef46 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:11.150029 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b5abfda7-ab2d-4e58-8703-8dbd36f4ef46 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:11.150689 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b5abfda7-ab2d-4e58-8703-8dbd36f4ef46 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:11.151333 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b5abfda7-ab2d-4e58-8703-8dbd36f4ef46 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:11.152195 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b5abfda7-ab2d-4e58-8703-8dbd36f4ef46 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:11.152788 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b5abfda7-ab2d-4e58-8703-8dbd36f4ef46 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:11.153448 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b5abfda7-ab2d-4e58-8703-8dbd36f4ef46 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:11.240644 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.objects.instance [None req-b5abfda7-ab2d-4e58-8703-8dbd36f4ef46 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lazy-loading 'flavor' on Instance uuid de7a8eee-34d7-45c9-bbc0-5b9f954776e7 {{(pid=120704) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 13:00:11.399750 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-926d0da1-ec3f-4e45-a50e-4172424b5baf tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:11.404204 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-b5abfda7-ab2d-4e58-8703-8dbd36f4ef46 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "POST /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7/action" status: 200 len: 32 microversion: 2.1 time: 0.284254 Aug 31 13:00:11.404947 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 97/179] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 31 13:00:11 2022] POST /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7/action => generated 32 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 13:00:11.413928 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-926d0da1-ec3f-4e45-a50e-4172424b5baf tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1363 microversion: 2.1 time: 0.393669 Aug 31 13:00:11.415078 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 83/180] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:11 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1363 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:11.419243 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-fb7e90cf-71ae-4738-84b8-57d82536ae09 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:11.420198 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-fb7e90cf-71ae-4738-84b8-57d82536ae09 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:11.427338 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fb7e90cf-71ae-4738-84b8-57d82536ae09 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:11.428066 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fb7e90cf-71ae-4738-84b8-57d82536ae09 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:11.428592 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fb7e90cf-71ae-4738-84b8-57d82536ae09 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:11.429446 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fb7e90cf-71ae-4738-84b8-57d82536ae09 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:11.430543 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fb7e90cf-71ae-4738-84b8-57d82536ae09 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:11.431265 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fb7e90cf-71ae-4738-84b8-57d82536ae09 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:11.678087 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-fb7e90cf-71ae-4738-84b8-57d82536ae09 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:11.687388 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-fb7e90cf-71ae-4738-84b8-57d82536ae09 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.276222 Aug 31 13:00:11.688105 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 98/181] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:11 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:12.435113 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b5d2dd06-6dfd-4d9f-9014-7d6708ab89ea tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:12.435727 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b5d2dd06-6dfd-4d9f-9014-7d6708ab89ea tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:12.442413 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b5d2dd06-6dfd-4d9f-9014-7d6708ab89ea tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:12.443245 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b5d2dd06-6dfd-4d9f-9014-7d6708ab89ea tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:12.443934 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b5d2dd06-6dfd-4d9f-9014-7d6708ab89ea tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:12.444936 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b5d2dd06-6dfd-4d9f-9014-7d6708ab89ea tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:12.445454 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b5d2dd06-6dfd-4d9f-9014-7d6708ab89ea tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:12.445948 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b5d2dd06-6dfd-4d9f-9014-7d6708ab89ea tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:12.725369 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-60dbc8cf-a569-4f61-8074-625a9767b302 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "baf8708c-a3cb-497f-aebe-6dfb73974fae"}} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:00:12.728457 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-60dbc8cf-a569-4f61-8074-625a9767b302 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:12.738538 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-60dbc8cf-a569-4f61-8074-625a9767b302 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:12.739027 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-60dbc8cf-a569-4f61-8074-625a9767b302 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:12.739449 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-60dbc8cf-a569-4f61-8074-625a9767b302 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:12.740176 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-60dbc8cf-a569-4f61-8074-625a9767b302 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:12.740615 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-60dbc8cf-a569-4f61-8074-625a9767b302 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:12.741029 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-60dbc8cf-a569-4f61-8074-625a9767b302 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:12.776651 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-b5d2dd06-6dfd-4d9f-9014-7d6708ab89ea tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:12.802590 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b5d2dd06-6dfd-4d9f-9014-7d6708ab89ea tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1363 microversion: 2.1 time: 0.371640 Aug 31 13:00:12.803462 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 84/182] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:12 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1363 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:12.811423 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-97b7f4f2-df42-4fba-b315-070b74cc96f8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:12.812564 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-97b7f4f2-df42-4fba-b315-070b74cc96f8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:12.820608 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-97b7f4f2-df42-4fba-b315-070b74cc96f8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:12.821911 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-97b7f4f2-df42-4fba-b315-070b74cc96f8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:12.822495 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-97b7f4f2-df42-4fba-b315-070b74cc96f8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:12.823340 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-97b7f4f2-df42-4fba-b315-070b74cc96f8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:12.823912 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-97b7f4f2-df42-4fba-b315-070b74cc96f8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:12.824852 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-97b7f4f2-df42-4fba-b315-070b74cc96f8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:13.056520 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-97b7f4f2-df42-4fba-b315-070b74cc96f8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:13.066781 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-97b7f4f2-df42-4fba-b315-070b74cc96f8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.260410 Aug 31 13:00:13.067424 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 85/183] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:12 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:13.825441 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-711f2a39-8054-4316-9822-c667a2ed63fe tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:13.826527 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-711f2a39-8054-4316-9822-c667a2ed63fe tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:13.840685 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-711f2a39-8054-4316-9822-c667a2ed63fe tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:13.843031 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-711f2a39-8054-4316-9822-c667a2ed63fe tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:13.843491 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-711f2a39-8054-4316-9822-c667a2ed63fe tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:13.847415 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-711f2a39-8054-4316-9822-c667a2ed63fe tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:13.847966 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-711f2a39-8054-4316-9822-c667a2ed63fe tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:13.849260 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-711f2a39-8054-4316-9822-c667a2ed63fe tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:13.911568 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-60dbc8cf-a569-4f61-8074-625a9767b302 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "POST /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.194532 Aug 31 13:00:13.915207 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 99/184] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 31 13:00:12 2022] POST /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea/os-volume_attachments => generated 194 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:00:14.046431 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-711f2a39-8054-4316-9822-c667a2ed63fe tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:14.055658 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-711f2a39-8054-4316-9822-c667a2ed63fe tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1363 microversion: 2.1 time: 0.235017 Aug 31 13:00:14.056289 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 86/185] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:13 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:00:14.090570 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-2e3fe7c3-c8c7-4171-8293-789889471131 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:14.091269 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-2e3fe7c3-c8c7-4171-8293-789889471131 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:14.108947 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2e3fe7c3-c8c7-4171-8293-789889471131 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:14.109427 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2e3fe7c3-c8c7-4171-8293-789889471131 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:14.109848 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2e3fe7c3-c8c7-4171-8293-789889471131 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:14.110742 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2e3fe7c3-c8c7-4171-8293-789889471131 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:14.111466 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2e3fe7c3-c8c7-4171-8293-789889471131 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:14.112150 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2e3fe7c3-c8c7-4171-8293-789889471131 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:14.309778 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-2e3fe7c3-c8c7-4171-8293-789889471131 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:14.318386 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-2e3fe7c3-c8c7-4171-8293-789889471131 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.232404 Aug 31 13:00:14.332939 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 100/186] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:14 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:15.082793 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-7135eb64-60ce-4080-88dd-5c59e07a45e5 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:15.083509 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-7135eb64-60ce-4080-88dd-5c59e07a45e5 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:15.097629 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7135eb64-60ce-4080-88dd-5c59e07a45e5 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:15.099096 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7135eb64-60ce-4080-88dd-5c59e07a45e5 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:15.099943 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7135eb64-60ce-4080-88dd-5c59e07a45e5 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:15.101285 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7135eb64-60ce-4080-88dd-5c59e07a45e5 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:15.102648 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7135eb64-60ce-4080-88dd-5c59e07a45e5 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:15.103369 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7135eb64-60ce-4080-88dd-5c59e07a45e5 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:15.285356 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-7135eb64-60ce-4080-88dd-5c59e07a45e5 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:15.293961 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-7135eb64-60ce-4080-88dd-5c59e07a45e5 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1363 microversion: 2.1 time: 0.217275 Aug 31 13:00:15.294534 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 87/187] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:15 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:00:15.339566 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-22375d2f-fcae-4dd1-b0ba-425ccd1e75c8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:15.340796 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-22375d2f-fcae-4dd1-b0ba-425ccd1e75c8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:15.347277 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-22375d2f-fcae-4dd1-b0ba-425ccd1e75c8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:15.347755 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-22375d2f-fcae-4dd1-b0ba-425ccd1e75c8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:15.348488 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-22375d2f-fcae-4dd1-b0ba-425ccd1e75c8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:15.349234 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-22375d2f-fcae-4dd1-b0ba-425ccd1e75c8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:15.349680 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-22375d2f-fcae-4dd1-b0ba-425ccd1e75c8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:15.350104 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-22375d2f-fcae-4dd1-b0ba-425ccd1e75c8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:15.371085 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:15.505142 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-22375d2f-fcae-4dd1-b0ba-425ccd1e75c8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:15.513219 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-22375d2f-fcae-4dd1-b0ba-425ccd1e75c8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.177595 Aug 31 13:00:15.513788 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 101/188] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:15 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:16.316517 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-01cfee05-4bcb-4842-8191-5bb404b4a5ba tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:16.317778 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-01cfee05-4bcb-4842-8191-5bb404b4a5ba tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:16.324319 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-01cfee05-4bcb-4842-8191-5bb404b4a5ba tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:16.325786 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-01cfee05-4bcb-4842-8191-5bb404b4a5ba tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:16.326718 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-01cfee05-4bcb-4842-8191-5bb404b4a5ba tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:16.327424 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-01cfee05-4bcb-4842-8191-5bb404b4a5ba tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:16.327958 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-01cfee05-4bcb-4842-8191-5bb404b4a5ba tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:16.328434 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-01cfee05-4bcb-4842-8191-5bb404b4a5ba tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:16.515635 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-01cfee05-4bcb-4842-8191-5bb404b4a5ba tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:16.531904 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-01cfee05-4bcb-4842-8191-5bb404b4a5ba tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1363 microversion: 2.1 time: 0.220788 Aug 31 13:00:16.532546 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 88/189] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:16 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:00:16.536402 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-b782c282-25e7-4219-a387-cc2b5f33b79c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:16.537714 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-b782c282-25e7-4219-a387-cc2b5f33b79c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:16.540962 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell0:SELECT=4 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:16.545986 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b782c282-25e7-4219-a387-cc2b5f33b79c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:16.546718 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b782c282-25e7-4219-a387-cc2b5f33b79c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:16.547493 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b782c282-25e7-4219-a387-cc2b5f33b79c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:16.548237 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b782c282-25e7-4219-a387-cc2b5f33b79c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:16.548706 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b782c282-25e7-4219-a387-cc2b5f33b79c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:16.549116 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b782c282-25e7-4219-a387-cc2b5f33b79c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:16.687255 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-b782c282-25e7-4219-a387-cc2b5f33b79c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:16.695378 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-b782c282-25e7-4219-a387-cc2b5f33b79c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.165212 Aug 31 13:00:16.695988 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 102/190] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:16 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:00:17.556787 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-a7d769da-1088-46e7-8e9b-4814e058599f tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:17.558303 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-a7d769da-1088-46e7-8e9b-4814e058599f tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:17.565997 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a7d769da-1088-46e7-8e9b-4814e058599f tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:17.566856 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a7d769da-1088-46e7-8e9b-4814e058599f tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:17.567343 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a7d769da-1088-46e7-8e9b-4814e058599f tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:17.568186 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a7d769da-1088-46e7-8e9b-4814e058599f tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:17.568632 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a7d769da-1088-46e7-8e9b-4814e058599f tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:17.569049 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a7d769da-1088-46e7-8e9b-4814e058599f tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:17.716610 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-c6873da0-7233-4036-8b3c-0152dff95c81 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:17.717814 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-c6873da0-7233-4036-8b3c-0152dff95c81 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:17.727644 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c6873da0-7233-4036-8b3c-0152dff95c81 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:17.732328 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c6873da0-7233-4036-8b3c-0152dff95c81 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:17.732939 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c6873da0-7233-4036-8b3c-0152dff95c81 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:17.733866 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c6873da0-7233-4036-8b3c-0152dff95c81 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:17.742964 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c6873da0-7233-4036-8b3c-0152dff95c81 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:17.742964 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c6873da0-7233-4036-8b3c-0152dff95c81 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:17.750533 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-a7d769da-1088-46e7-8e9b-4814e058599f tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:17.760274 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-a7d769da-1088-46e7-8e9b-4814e058599f tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1549 microversion: 2.1 time: 0.208872 Aug 31 13:00:17.761551 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 89/191] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:17 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1549 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:17.795882 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e825e1d5-2123-45c5-ac3e-05952c96880f tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:17.797015 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e825e1d5-2123-45c5-ac3e-05952c96880f tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:17.804606 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e825e1d5-2123-45c5-ac3e-05952c96880f tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:17.805731 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e825e1d5-2123-45c5-ac3e-05952c96880f tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:17.806399 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e825e1d5-2123-45c5-ac3e-05952c96880f tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:17.807328 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e825e1d5-2123-45c5-ac3e-05952c96880f tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:17.808458 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e825e1d5-2123-45c5-ac3e-05952c96880f tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:17.809073 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e825e1d5-2123-45c5-ac3e-05952c96880f tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:17.994571 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e825e1d5-2123-45c5-ac3e-05952c96880f tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.213880 Aug 31 13:00:17.995178 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 90/192] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 31 13:00:17 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf/os-interface => generated 284 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:00:17.999806 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-c6873da0-7233-4036-8b3c-0152dff95c81 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:18.008066 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-c6873da0-7233-4036-8b3c-0152dff95c81 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.295143 Aug 31 13:00:18.008655 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 103/193] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:17 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:19.029468 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-da5771fe-88eb-445c-93ea-26ebe7436083 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:19.030102 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-da5771fe-88eb-445c-93ea-26ebe7436083 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:19.037183 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-da5771fe-88eb-445c-93ea-26ebe7436083 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:19.037536 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-da5771fe-88eb-445c-93ea-26ebe7436083 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:19.038066 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-da5771fe-88eb-445c-93ea-26ebe7436083 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:19.044778 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-da5771fe-88eb-445c-93ea-26ebe7436083 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:19.046135 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-da5771fe-88eb-445c-93ea-26ebe7436083 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:19.046809 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-da5771fe-88eb-445c-93ea-26ebe7436083 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:19.202325 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-da5771fe-88eb-445c-93ea-26ebe7436083 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:19.211927 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-da5771fe-88eb-445c-93ea-26ebe7436083 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.186055 Aug 31 13:00:19.213038 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 91/194] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:19 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:19.405761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-cd0c5594-b2a8-4b89-81f4-48f005178dd0 req-57d0746f-cbc3-4206-b381-49e849ceed93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48f08cc0-15cb-4884-960b-a96396a0d4bf", "tag": "d7daad8a-fae2-4a08-ba82-bc48fa334e9e"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:00:19.418370 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-cd0c5594-b2a8-4b89-81f4-48f005178dd0 req-57d0746f-cbc3-4206-b381-49e849ceed93 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:19.418932 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-cd0c5594-b2a8-4b89-81f4-48f005178dd0 req-57d0746f-cbc3-4206-b381-49e849ceed93 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:19.419356 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-cd0c5594-b2a8-4b89-81f4-48f005178dd0 req-57d0746f-cbc3-4206-b381-49e849ceed93 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:19.434391 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-cd0c5594-b2a8-4b89-81f4-48f005178dd0 req-57d0746f-cbc3-4206-b381-49e849ceed93 service nova] Creating event network-changed:d7daad8a-fae2-4a08-ba82-bc48fa334e9e for instance 48f08cc0-15cb-4884-960b-a96396a0d4bf on hv-cinder-85442 Aug 31 13:00:19.440651 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-cd0c5594-b2a8-4b89-81f4-48f005178dd0 req-57d0746f-cbc3-4206-b381-49e849ceed93 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039089 Aug 31 13:00:19.443959 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 104/195] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:00:20.233746 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-2ca96273-c74e-4b34-b2ea-1f80458c4a4a tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:20.234373 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-2ca96273-c74e-4b34-b2ea-1f80458c4a4a tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:20.242487 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2ca96273-c74e-4b34-b2ea-1f80458c4a4a tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:20.243208 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2ca96273-c74e-4b34-b2ea-1f80458c4a4a tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:20.243625 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2ca96273-c74e-4b34-b2ea-1f80458c4a4a tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:20.244333 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2ca96273-c74e-4b34-b2ea-1f80458c4a4a tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:20.244773 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2ca96273-c74e-4b34-b2ea-1f80458c4a4a tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:20.245181 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2ca96273-c74e-4b34-b2ea-1f80458c4a4a tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:20.388201 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-2ca96273-c74e-4b34-b2ea-1f80458c4a4a tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:20.392159 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=100 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:20.401703 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-2ca96273-c74e-4b34-b2ea-1f80458c4a4a tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.171749 Aug 31 13:00:20.402223 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 92/196] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:20 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:21.431531 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-b80f6f61-f2ce-42f8-8b54-2ee32e923b82 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:21.432824 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-b80f6f61-f2ce-42f8-8b54-2ee32e923b82 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:21.443691 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b80f6f61-f2ce-42f8-8b54-2ee32e923b82 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:21.444620 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b80f6f61-f2ce-42f8-8b54-2ee32e923b82 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:21.445146 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b80f6f61-f2ce-42f8-8b54-2ee32e923b82 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:21.445838 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b80f6f61-f2ce-42f8-8b54-2ee32e923b82 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:21.446284 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b80f6f61-f2ce-42f8-8b54-2ee32e923b82 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:21.446732 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b80f6f61-f2ce-42f8-8b54-2ee32e923b82 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:21.587051 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-b80f6f61-f2ce-42f8-8b54-2ee32e923b82 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:21.595682 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-b80f6f61-f2ce-42f8-8b54-2ee32e923b82 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.174148 Aug 31 13:00:21.596310 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 105/197] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:21 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:22.616890 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-cb5e29dd-6238-4f4d-b18d-c8ea71d55d79 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:22.617495 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-cb5e29dd-6238-4f4d-b18d-c8ea71d55d79 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:22.623872 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cb5e29dd-6238-4f4d-b18d-c8ea71d55d79 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:22.624370 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cb5e29dd-6238-4f4d-b18d-c8ea71d55d79 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:22.624797 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cb5e29dd-6238-4f4d-b18d-c8ea71d55d79 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:22.625486 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cb5e29dd-6238-4f4d-b18d-c8ea71d55d79 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:22.625924 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cb5e29dd-6238-4f4d-b18d-c8ea71d55d79 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:22.626341 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cb5e29dd-6238-4f4d-b18d-c8ea71d55d79 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:22.760213 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-cb5e29dd-6238-4f4d-b18d-c8ea71d55d79 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:22.767962 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-cb5e29dd-6238-4f4d-b18d-c8ea71d55d79 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.155015 Aug 31 13:00:22.768556 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 93/198] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:22 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:23.790976 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-2b37ad56-be6c-4a9b-bef6-f98d6e4c0ab8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:23.791604 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-2b37ad56-be6c-4a9b-bef6-f98d6e4c0ab8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:23.798334 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2b37ad56-be6c-4a9b-bef6-f98d6e4c0ab8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:23.798815 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2b37ad56-be6c-4a9b-bef6-f98d6e4c0ab8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:23.799208 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2b37ad56-be6c-4a9b-bef6-f98d6e4c0ab8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:23.800123 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2b37ad56-be6c-4a9b-bef6-f98d6e4c0ab8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:23.800448 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2b37ad56-be6c-4a9b-bef6-f98d6e4c0ab8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:23.800988 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2b37ad56-be6c-4a9b-bef6-f98d6e4c0ab8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:23.940392 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-2b37ad56-be6c-4a9b-bef6-f98d6e4c0ab8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:23.951759 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-2b37ad56-be6c-4a9b-bef6-f98d6e4c0ab8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.165905 Aug 31 13:00:23.952571 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 106/199] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:23 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:24.975071 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-f71cae87-3f77-404f-898b-459d3647c0b9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:24.975758 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-f71cae87-3f77-404f-898b-459d3647c0b9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:24.982435 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f71cae87-3f77-404f-898b-459d3647c0b9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:24.982918 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f71cae87-3f77-404f-898b-459d3647c0b9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:24.983342 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f71cae87-3f77-404f-898b-459d3647c0b9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:24.984129 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f71cae87-3f77-404f-898b-459d3647c0b9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:24.984936 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f71cae87-3f77-404f-898b-459d3647c0b9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:24.985681 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f71cae87-3f77-404f-898b-459d3647c0b9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:25.130557 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-f71cae87-3f77-404f-898b-459d3647c0b9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:25.141514 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-f71cae87-3f77-404f-898b-459d3647c0b9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.170088 Aug 31 13:00:25.142270 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 94/200] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:24 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:26.174546 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-82c36ffc-3e71-4ed5-9f43-08134634c6c0 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:26.175411 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-82c36ffc-3e71-4ed5-9f43-08134634c6c0 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:26.183711 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-82c36ffc-3e71-4ed5-9f43-08134634c6c0 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:26.184225 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-82c36ffc-3e71-4ed5-9f43-08134634c6c0 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:26.184657 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-82c36ffc-3e71-4ed5-9f43-08134634c6c0 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:26.185346 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-82c36ffc-3e71-4ed5-9f43-08134634c6c0 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:26.185793 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-82c36ffc-3e71-4ed5-9f43-08134634c6c0 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:26.186233 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-82c36ffc-3e71-4ed5-9f43-08134634c6c0 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:26.331216 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-82c36ffc-3e71-4ed5-9f43-08134634c6c0 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:26.340784 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-82c36ffc-3e71-4ed5-9f43-08134634c6c0 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.173022 Aug 31 13:00:26.341395 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 107/201] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:26 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:27.365674 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-01896089-9d0c-4dac-96f2-ca884d0d4966 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:27.366766 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-01896089-9d0c-4dac-96f2-ca884d0d4966 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:27.377119 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-01896089-9d0c-4dac-96f2-ca884d0d4966 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:27.377938 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-01896089-9d0c-4dac-96f2-ca884d0d4966 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:27.378647 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-01896089-9d0c-4dac-96f2-ca884d0d4966 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:27.379766 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-01896089-9d0c-4dac-96f2-ca884d0d4966 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:27.380560 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-01896089-9d0c-4dac-96f2-ca884d0d4966 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:27.381258 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-01896089-9d0c-4dac-96f2-ca884d0d4966 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:27.525334 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-01896089-9d0c-4dac-96f2-ca884d0d4966 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:27.535093 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-01896089-9d0c-4dac-96f2-ca884d0d4966 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.175853 Aug 31 13:00:27.535704 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 95/202] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:27 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:28.557647 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-2aa0636c-d026-4930-bbf0-009aeb94e71c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:28.558250 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-2aa0636c-d026-4930-bbf0-009aeb94e71c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:28.565470 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2aa0636c-d026-4930-bbf0-009aeb94e71c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:28.565946 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2aa0636c-d026-4930-bbf0-009aeb94e71c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:28.566403 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2aa0636c-d026-4930-bbf0-009aeb94e71c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:28.567074 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2aa0636c-d026-4930-bbf0-009aeb94e71c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:28.567520 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2aa0636c-d026-4930-bbf0-009aeb94e71c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:28.567955 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2aa0636c-d026-4930-bbf0-009aeb94e71c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:28.714028 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-2aa0636c-d026-4930-bbf0-009aeb94e71c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:28.722366 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-2aa0636c-d026-4930-bbf0-009aeb94e71c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.169138 Aug 31 13:00:28.722926 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 108/203] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:28 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:29.742975 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-9458dfaa-a57b-41e2-92ef-43b159ee9714 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:29.743672 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-9458dfaa-a57b-41e2-92ef-43b159ee9714 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:29.752743 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9458dfaa-a57b-41e2-92ef-43b159ee9714 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:29.753624 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9458dfaa-a57b-41e2-92ef-43b159ee9714 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:29.754125 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9458dfaa-a57b-41e2-92ef-43b159ee9714 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:29.754902 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9458dfaa-a57b-41e2-92ef-43b159ee9714 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:29.756114 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9458dfaa-a57b-41e2-92ef-43b159ee9714 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:29.756599 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9458dfaa-a57b-41e2-92ef-43b159ee9714 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:29.931344 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-9458dfaa-a57b-41e2-92ef-43b159ee9714 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:29.948758 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-9458dfaa-a57b-41e2-92ef-43b159ee9714 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.209827 Aug 31 13:00:29.963781 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 96/204] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:29 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:30.970910 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-5ad1b1f1-ccb5-4a87-bc33-26227878d5bb tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:30.971512 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-5ad1b1f1-ccb5-4a87-bc33-26227878d5bb tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:30.974133 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:30.979500 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5ad1b1f1-ccb5-4a87-bc33-26227878d5bb tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:30.980006 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5ad1b1f1-ccb5-4a87-bc33-26227878d5bb tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:30.980425 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5ad1b1f1-ccb5-4a87-bc33-26227878d5bb tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:30.981104 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5ad1b1f1-ccb5-4a87-bc33-26227878d5bb tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:30.981548 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5ad1b1f1-ccb5-4a87-bc33-26227878d5bb tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:30.981966 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5ad1b1f1-ccb5-4a87-bc33-26227878d5bb tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:31.128231 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-5ad1b1f1-ccb5-4a87-bc33-26227878d5bb tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:31.136066 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-5ad1b1f1-ccb5-4a87-bc33-26227878d5bb tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.169046 Aug 31 13:00:31.136648 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 109/205] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:30 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:32.157236 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-5ff7d01b-3714-4793-b2ed-abcc766887e1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:32.157891 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-5ff7d01b-3714-4793-b2ed-abcc766887e1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:32.167309 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5ff7d01b-3714-4793-b2ed-abcc766887e1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:32.167793 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5ff7d01b-3714-4793-b2ed-abcc766887e1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:32.168506 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5ff7d01b-3714-4793-b2ed-abcc766887e1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:32.181963 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5ff7d01b-3714-4793-b2ed-abcc766887e1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:32.182613 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5ff7d01b-3714-4793-b2ed-abcc766887e1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:32.183061 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5ff7d01b-3714-4793-b2ed-abcc766887e1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:32.334001 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-5ff7d01b-3714-4793-b2ed-abcc766887e1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:32.346675 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-5ff7d01b-3714-4793-b2ed-abcc766887e1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.193720 Aug 31 13:00:32.348008 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 97/206] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:32 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:33.308716 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-3418bef9-fb07-4412-a08b-f7bd8b4f53ec tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:33.309230 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-3418bef9-fb07-4412-a08b-f7bd8b4f53ec tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:33.316121 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3418bef9-fb07-4412-a08b-f7bd8b4f53ec tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:33.316598 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3418bef9-fb07-4412-a08b-f7bd8b4f53ec tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:33.317018 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3418bef9-fb07-4412-a08b-f7bd8b4f53ec tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:33.317693 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3418bef9-fb07-4412-a08b-f7bd8b4f53ec tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:33.318154 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3418bef9-fb07-4412-a08b-f7bd8b4f53ec tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:33.318552 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3418bef9-fb07-4412-a08b-f7bd8b4f53ec tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:33.350007 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-3418bef9-fb07-4412-a08b-f7bd8b4f53ec tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Going to try to terminate instance {{(pid=120704) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 13:00:33.386027 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-be4c18f2-8db0-4899-af06-0b088f79dd54 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:33.387550 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-be4c18f2-8db0-4899-af06-0b088f79dd54 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:33.399731 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-be4c18f2-8db0-4899-af06-0b088f79dd54 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:33.404304 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-be4c18f2-8db0-4899-af06-0b088f79dd54 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:33.404995 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-be4c18f2-8db0-4899-af06-0b088f79dd54 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:33.406886 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-be4c18f2-8db0-4899-af06-0b088f79dd54 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:33.409108 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-be4c18f2-8db0-4899-af06-0b088f79dd54 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:33.409734 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-be4c18f2-8db0-4899-af06-0b088f79dd54 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:33.478603 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-3418bef9-fb07-4412-a08b-f7bd8b4f53ec tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "DELETE /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 204 len: 0 microversion: 2.1 time: 0.173476 Aug 31 13:00:33.479669 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 110/207] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 31 13:00:33 2022] DELETE /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:00:33.493770 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-9e1675ad-ad2a-498b-a70b-5f2c21c00add tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:33.494887 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-9e1675ad-ad2a-498b-a70b-5f2c21c00add tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:33.501469 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9e1675ad-ad2a-498b-a70b-5f2c21c00add tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:33.501982 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9e1675ad-ad2a-498b-a70b-5f2c21c00add tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:33.502438 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9e1675ad-ad2a-498b-a70b-5f2c21c00add tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:33.503494 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9e1675ad-ad2a-498b-a70b-5f2c21c00add tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:33.504080 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9e1675ad-ad2a-498b-a70b-5f2c21c00add tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:33.504595 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9e1675ad-ad2a-498b-a70b-5f2c21c00add tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:33.619788 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-be4c18f2-8db0-4899-af06-0b088f79dd54 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:33.628677 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-be4c18f2-8db0-4899-af06-0b088f79dd54 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.258493 Aug 31 13:00:33.629535 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 98/208] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:33 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:33.674924 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-9e1675ad-ad2a-498b-a70b-5f2c21c00add tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63adaf56e417cba603f908a8e451c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0eff3111a5847a68620fce8060df208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:33.685777 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-9e1675ad-ad2a-498b-a70b-5f2c21c00add tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 200 len: 1553 microversion: 2.1 time: 0.200941 Aug 31 13:00:33.686813 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 111/209] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:33 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 1553 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:00:34.649809 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-cb2a9783-c23a-4297-8e44-cc99c06c737d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:34.650501 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-cb2a9783-c23a-4297-8e44-cc99c06c737d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:34.656626 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cb2a9783-c23a-4297-8e44-cc99c06c737d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:34.657170 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cb2a9783-c23a-4297-8e44-cc99c06c737d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:34.657600 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cb2a9783-c23a-4297-8e44-cc99c06c737d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:34.658279 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cb2a9783-c23a-4297-8e44-cc99c06c737d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:34.658721 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cb2a9783-c23a-4297-8e44-cc99c06c737d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:34.659132 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cb2a9783-c23a-4297-8e44-cc99c06c737d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:34.713821 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-44081619-54b7-4d11-b1d2-8ea18c10fec7 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:34.714406 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-44081619-54b7-4d11-b1d2-8ea18c10fec7 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:34.720295 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-44081619-54b7-4d11-b1d2-8ea18c10fec7 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:34.720871 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-44081619-54b7-4d11-b1d2-8ea18c10fec7 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:34.721317 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-44081619-54b7-4d11-b1d2-8ea18c10fec7 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:34.721996 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-44081619-54b7-4d11-b1d2-8ea18c10fec7 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:34.724133 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-44081619-54b7-4d11-b1d2-8ea18c10fec7 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:34.724133 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-44081619-54b7-4d11-b1d2-8ea18c10fec7 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:34.854954 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-cb2a9783-c23a-4297-8e44-cc99c06c737d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:34.871444 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-cb2a9783-c23a-4297-8e44-cc99c06c737d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.225511 Aug 31 13:00:34.877051 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 99/210] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:34 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:34.897892 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-44081619-54b7-4d11-b1d2-8ea18c10fec7 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63adaf56e417cba603f908a8e451c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0eff3111a5847a68620fce8060df208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:34.906181 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-44081619-54b7-4d11-b1d2-8ea18c10fec7 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 200 len: 1553 microversion: 2.1 time: 0.203117 Aug 31 13:00:34.906947 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 112/211] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:34 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 1553 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:00:35.899439 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-ca0a14ac-5dd0-45a7-9a3e-ebe135fa3744 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:35.899994 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-ca0a14ac-5dd0-45a7-9a3e-ebe135fa3744 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:35.907686 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ca0a14ac-5dd0-45a7-9a3e-ebe135fa3744 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:35.908205 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ca0a14ac-5dd0-45a7-9a3e-ebe135fa3744 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:35.908611 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ca0a14ac-5dd0-45a7-9a3e-ebe135fa3744 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:35.909326 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ca0a14ac-5dd0-45a7-9a3e-ebe135fa3744 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:35.909776 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ca0a14ac-5dd0-45a7-9a3e-ebe135fa3744 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:35.910196 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ca0a14ac-5dd0-45a7-9a3e-ebe135fa3744 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:35.928551 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-383d1676-672a-4740-b0b4-dc7d1b1cf92a tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:35.929124 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-383d1676-672a-4740-b0b4-dc7d1b1cf92a tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:35.936501 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-383d1676-672a-4740-b0b4-dc7d1b1cf92a tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:35.937231 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-383d1676-672a-4740-b0b4-dc7d1b1cf92a tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:35.937828 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-383d1676-672a-4740-b0b4-dc7d1b1cf92a tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:35.938533 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-383d1676-672a-4740-b0b4-dc7d1b1cf92a tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:35.938977 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-383d1676-672a-4740-b0b4-dc7d1b1cf92a tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:35.939397 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-383d1676-672a-4740-b0b4-dc7d1b1cf92a tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:36.326791 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-ca0a14ac-5dd0-45a7-9a3e-ebe135fa3744 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:36.334647 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-ca0a14ac-5dd0-45a7-9a3e-ebe135fa3744 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.441561 Aug 31 13:00:36.335374 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 100/212] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:35 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:36.352452 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-383d1676-672a-4740-b0b4-dc7d1b1cf92a tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63adaf56e417cba603f908a8e451c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0eff3111a5847a68620fce8060df208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:36.362290 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-383d1676-672a-4740-b0b4-dc7d1b1cf92a tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 200 len: 1553 microversion: 2.1 time: 0.437826 Aug 31 13:00:36.363379 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 113/213] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:35 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 1553 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:37.355732 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-91e5a569-59c5-4e6e-b348-36130fec0eea tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:37.356880 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-91e5a569-59c5-4e6e-b348-36130fec0eea tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:37.363774 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-91e5a569-59c5-4e6e-b348-36130fec0eea tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:37.364502 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-91e5a569-59c5-4e6e-b348-36130fec0eea tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:37.365088 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-91e5a569-59c5-4e6e-b348-36130fec0eea tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:37.366008 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-91e5a569-59c5-4e6e-b348-36130fec0eea tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:37.366432 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-91e5a569-59c5-4e6e-b348-36130fec0eea tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:37.366844 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-91e5a569-59c5-4e6e-b348-36130fec0eea tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:37.385219 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-664b99c0-b874-4c15-ab46-02aa27acd04e tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:37.385934 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-664b99c0-b874-4c15-ab46-02aa27acd04e tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:37.392986 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-664b99c0-b874-4c15-ab46-02aa27acd04e tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:37.393720 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-664b99c0-b874-4c15-ab46-02aa27acd04e tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:37.394411 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-664b99c0-b874-4c15-ab46-02aa27acd04e tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:37.395260 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-664b99c0-b874-4c15-ab46-02aa27acd04e tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:37.396068 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-664b99c0-b874-4c15-ab46-02aa27acd04e tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:37.396641 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-664b99c0-b874-4c15-ab46-02aa27acd04e tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:37.499709 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-664b99c0-b874-4c15-ab46-02aa27acd04e tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63adaf56e417cba603f908a8e451c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0eff3111a5847a68620fce8060df208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:37.510771 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-664b99c0-b874-4c15-ab46-02aa27acd04e tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 200 len: 1511 microversion: 2.1 time: 0.129724 Aug 31 13:00:37.511693 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 114/214] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:37 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 1511 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:37.516557 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-e50f8a4c-b193-4154-9b11-f27a0762cf94 req-562948be-0d52-4263-8f0e-fb09076b5aaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "447f6c66-64aa-4e88-a317-27c64b4d82ea", "name": "network-vif-deleted", "tag": "e224a14c-9b7e-409c-aa96-28fe27b7f502"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:00:37.526635 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-e50f8a4c-b193-4154-9b11-f27a0762cf94 req-562948be-0d52-4263-8f0e-fb09076b5aaa service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:37.527095 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-e50f8a4c-b193-4154-9b11-f27a0762cf94 req-562948be-0d52-4263-8f0e-fb09076b5aaa service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:37.527672 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-e50f8a4c-b193-4154-9b11-f27a0762cf94 req-562948be-0d52-4263-8f0e-fb09076b5aaa service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:37.549438 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-e50f8a4c-b193-4154-9b11-f27a0762cf94 req-562948be-0d52-4263-8f0e-fb09076b5aaa service nova] Creating event network-vif-deleted:e224a14c-9b7e-409c-aa96-28fe27b7f502 for instance 447f6c66-64aa-4e88-a317-27c64b4d82ea on hv-cinder-85442 Aug 31 13:00:37.555480 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-e50f8a4c-b193-4154-9b11-f27a0762cf94 req-562948be-0d52-4263-8f0e-fb09076b5aaa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042339 Aug 31 13:00:37.557342 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 115/215] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:00:37.584557 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-91e5a569-59c5-4e6e-b348-36130fec0eea tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:37.593611 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-91e5a569-59c5-4e6e-b348-36130fec0eea tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.241725 Aug 31 13:00:37.594192 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 101/216] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:37 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:38.535780 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-731bec8b-7e9a-4127-a692-640294ed6c35 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:38.537208 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-731bec8b-7e9a-4127-a692-640294ed6c35 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:38.547222 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-731bec8b-7e9a-4127-a692-640294ed6c35 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:38.547942 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-731bec8b-7e9a-4127-a692-640294ed6c35 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:38.548696 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-731bec8b-7e9a-4127-a692-640294ed6c35 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:38.549407 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-731bec8b-7e9a-4127-a692-640294ed6c35 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:38.549834 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-731bec8b-7e9a-4127-a692-640294ed6c35 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:38.550523 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-731bec8b-7e9a-4127-a692-640294ed6c35 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:38.607199 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-731bec8b-7e9a-4127-a692-640294ed6c35 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:38.607686 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-731bec8b-7e9a-4127-a692-640294ed6c35 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:38.609648 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-731bec8b-7e9a-4127-a692-640294ed6c35 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:38.610051 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.objects.instance [None req-731bec8b-7e9a-4127-a692-640294ed6c35 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lazy-loading 'fault' on Instance uuid 447f6c66-64aa-4e88-a317-27c64b4d82ea {{(pid=120704) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 13:00:38.616216 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-579199de-63fc-4247-a214-279d6de6b524 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:38.616955 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-579199de-63fc-4247-a214-279d6de6b524 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:38.627727 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=46 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:38.633589 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-579199de-63fc-4247-a214-279d6de6b524 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:38.634325 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-579199de-63fc-4247-a214-279d6de6b524 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:38.634963 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-579199de-63fc-4247-a214-279d6de6b524 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:38.635931 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-579199de-63fc-4247-a214-279d6de6b524 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:38.636600 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-579199de-63fc-4247-a214-279d6de6b524 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:38.637323 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-579199de-63fc-4247-a214-279d6de6b524 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:38.706850 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-731bec8b-7e9a-4127-a692-640294ed6c35 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b63adaf56e417cba603f908a8e451c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0eff3111a5847a68620fce8060df208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:38.745149 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-731bec8b-7e9a-4127-a692-640294ed6c35 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 200 len: 1351 microversion: 2.1 time: 0.200212 Aug 31 13:00:38.746079 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 116/217] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:38 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 1351 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:00:38.900532 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-579199de-63fc-4247-a214-279d6de6b524 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:38.909187 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-579199de-63fc-4247-a214-279d6de6b524 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.298043 Aug 31 13:00:38.910168 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 102/218] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:38 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:39.767904 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-d251ba27-5423-4352-8dcd-9115ed210479 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:39.768995 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-d251ba27-5423-4352-8dcd-9115ed210479 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:39.776231 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d251ba27-5423-4352-8dcd-9115ed210479 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:39.776703 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d251ba27-5423-4352-8dcd-9115ed210479 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:39.777337 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d251ba27-5423-4352-8dcd-9115ed210479 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:39.778225 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d251ba27-5423-4352-8dcd-9115ed210479 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:39.779299 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d251ba27-5423-4352-8dcd-9115ed210479 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:39.779933 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d251ba27-5423-4352-8dcd-9115ed210479 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:39.794857 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.wsgi [None req-d251ba27-5423-4352-8dcd-9115ed210479 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] HTTP exception thrown: Instance 447f6c66-64aa-4e88-a317-27c64b4d82ea could not be found. Aug 31 13:00:39.799495 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-d251ba27-5423-4352-8dcd-9115ed210479 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Request method failure captured: Aug 31 13:00:39.799495 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: request: GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea HTTP/1.1 Aug 31 13:00:39.799495 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept: application/json Aug 31 13:00:39.799495 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept-Encoding: identity Aug 31 13:00:39.799495 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Connection: close Aug 31 13:00:39.799495 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Length: 0 Aug 31 13:00:39.799495 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Type: application/json Aug 31 13:00:39.799495 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Host: 10.222.0.58 Aug 31 13:00:39.799495 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Openstack-System-Scope: None Aug 31 13:00:39.799495 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: User-Agent: python-urllib3/1.26.12 Aug 31 13:00:39.799495 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Auth-Token: gAAAAABjD1sdH5JyTo1sJqAi524oYYOmFnlTaCeL-mTsmwb-R2SthDBSsyGy8ow_WtW1-gLeV_ndN3lhWzSMi3AK9M4FdDYDrsorzkh8Q9TYWbOVcMyAHu4jp7RNVCLgLP95w-aqO9DA4AkM37DTq2jH3dhx35xwTEx3iGTG0hyvBGtiFqM3VZ8 Aug 31 13:00:39.799495 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Id: None Aug 31 13:00:39.799495 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Name: None Aug 31 13:00:39.799495 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Identity-Status: Confirmed Aug 31 13:00:39.799495 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Is-Admin-Project: True Aug 31 13:00:39.799495 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Id: default Aug 31 13:00:39.799495 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Name: Default Aug 31 13:00:39.799495 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Id: f0eff3111a5847a68620fce8060df208 Aug 31 13:00:39.799495 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Name: tempest-DeleteServersTestJSON-71467556 Aug 31 13:00:39.799495 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Role: member,reader Aug 31 13:00:39.799495 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Roles: member,reader Aug 31 13:00:39.800974 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f0eff3111a5847a68620fce8060df208"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f0eff3111a5847a68620fce8060df208"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f0eff3111a5847a68620fce8060df208"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f0eff3111a5847a68620fce8060df208"}]}] Aug 31 13:00:39.800974 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant: tempest-DeleteServersTestJSON-71467556 Aug 31 13:00:39.800974 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Id: f0eff3111a5847a68620fce8060df208 Aug 31 13:00:39.800974 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Name: tempest-DeleteServersTestJSON-71467556 Aug 31 13:00:39.800974 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User: tempest-DeleteServersTestJSON-71467556-project Aug 31 13:00:39.800974 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Id: default Aug 31 13:00:39.800974 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Name: Default Aug 31 13:00:39.800974 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Id: 76b63adaf56e417cba603f908a8e451c Aug 31 13:00:39.800974 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Name: tempest-DeleteServersTestJSON-71467556-project Aug 31 13:00:39.800974 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: method: > Aug 31 13:00:39.800974 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: exception: Instance 447f6c66-64aa-4e88-a317-27c64b4d82ea could not be found. Aug 31 13:00:39.800974 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: action_args: {'id': '447f6c66-64aa-4e88-a317-27c64b4d82ea'} Aug 31 13:00:39.801761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:00:39.801761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:00:39.801761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 13:00:39.801761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 13:00:39.801761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 13:00:39.801761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 13:00:39.801761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 13:00:39.801761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 13:00:39.801761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 13:00:39.801761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 13:00:39.801761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 447f6c66-64aa-4e88-a317-27c64b4d82ea could not be found. Aug 31 13:00:39.801761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:00:39.801761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:00:39.801761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:00:39.801761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:00:39.801761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:00:39.801761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:00:39.801761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:00:39.801761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:00:39.801761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:00:39.803731 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:00:39.803731 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 13:00:39.803731 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 13:00:39.803731 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 13:00:39.803731 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 13:00:39.803731 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 13:00:39.803731 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 13:00:39.803731 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 447f6c66-64aa-4e88-a317-27c64b4d82ea could not be found. Aug 31 13:00:39.803731 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:00:39.803731 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:00:39.803731 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:00:39.803731 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:00:39.803731 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:00:39.803731 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:00:39.803731 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:00:39.803731 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:00:39.803731 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 447f6c66-64aa-4e88-a317-27c64b4d82ea could not be found. Aug 31 13:00:39.803731 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:00:39.806161 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-d251ba27-5423-4352-8dcd-9115ed210479 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Returning 404 to user: Instance 447f6c66-64aa-4e88-a317-27c64b4d82ea could not be found. {{(pid=120704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:00:39.807249 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-d251ba27-5423-4352-8dcd-9115ed210479 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 404 len: 111 microversion: 2.1 time: 0.044504 Aug 31 13:00:39.807861 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 117/219] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:39 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:00:39.932325 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-8012ead6-d33c-4ea3-9694-136a4dd8bf11 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:39.932866 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-1dc2fcef-3286-4aaf-a0c2-c04e8679df81 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:39.933634 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-1dc2fcef-3286-4aaf-a0c2-c04e8679df81 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:39.934576 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-8012ead6-d33c-4ea3-9694-136a4dd8bf11 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:39.941333 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8012ead6-d33c-4ea3-9694-136a4dd8bf11 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:39.941834 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8012ead6-d33c-4ea3-9694-136a4dd8bf11 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:39.942230 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8012ead6-d33c-4ea3-9694-136a4dd8bf11 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:39.942673 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1dc2fcef-3286-4aaf-a0c2-c04e8679df81 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:39.942913 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8012ead6-d33c-4ea3-9694-136a4dd8bf11 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:39.943193 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1dc2fcef-3286-4aaf-a0c2-c04e8679df81 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:39.943356 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8012ead6-d33c-4ea3-9694-136a4dd8bf11 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:39.943623 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1dc2fcef-3286-4aaf-a0c2-c04e8679df81 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:39.943761 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8012ead6-d33c-4ea3-9694-136a4dd8bf11 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:39.945764 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1dc2fcef-3286-4aaf-a0c2-c04e8679df81 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:39.946218 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1dc2fcef-3286-4aaf-a0c2-c04e8679df81 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:39.946643 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1dc2fcef-3286-4aaf-a0c2-c04e8679df81 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:39.951179 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:39.958015 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-8012ead6-d33c-4ea3-9694-136a4dd8bf11 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] HTTP exception thrown: Instance 447f6c66-64aa-4e88-a317-27c64b4d82ea could not be found. Aug 31 13:00:39.962542 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-8012ead6-d33c-4ea3-9694-136a4dd8bf11 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Request method failure captured: Aug 31 13:00:39.962542 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: request: GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea/os-volume_attachments HTTP/1.1 Aug 31 13:00:39.962542 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 31 13:00:39.962542 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 31 13:00:39.962542 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Connection: close Aug 31 13:00:39.962542 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 31 13:00:39.962542 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 31 13:00:39.962542 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Host: 10.222.0.58 Aug 31 13:00:39.962542 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 31 13:00:39.962542 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 31 13:00:39.962542 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjD1sdH5JyTo1sJqAi524oYYOmFnlTaCeL-mTsmwb-R2SthDBSsyGy8ow_WtW1-gLeV_ndN3lhWzSMi3AK9M4FdDYDrsorzkh8Q9TYWbOVcMyAHu4jp7RNVCLgLP95w-aqO9DA4AkM37DTq2jH3dhx35xwTEx3iGTG0hyvBGtiFqM3VZ8 Aug 31 13:00:39.962542 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 31 13:00:39.962542 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 31 13:00:39.962542 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 31 13:00:39.962542 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 31 13:00:39.962542 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 31 13:00:39.962542 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 31 13:00:39.962542 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Id: f0eff3111a5847a68620fce8060df208 Aug 31 13:00:39.962542 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-DeleteServersTestJSON-71467556 Aug 31 13:00:39.962542 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Role: member,reader Aug 31 13:00:39.962542 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Roles: member,reader Aug 31 13:00:39.963722 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f0eff3111a5847a68620fce8060df208"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f0eff3111a5847a68620fce8060df208"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f0eff3111a5847a68620fce8060df208"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f0eff3111a5847a68620fce8060df208"}]}] Aug 31 13:00:39.963722 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-DeleteServersTestJSON-71467556 Aug 31 13:00:39.963722 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant-Id: f0eff3111a5847a68620fce8060df208 Aug 31 13:00:39.963722 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-DeleteServersTestJSON-71467556 Aug 31 13:00:39.963722 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User: tempest-DeleteServersTestJSON-71467556-project Aug 31 13:00:39.963722 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 31 13:00:39.963722 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 31 13:00:39.963722 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Id: 76b63adaf56e417cba603f908a8e451c Aug 31 13:00:39.963722 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-DeleteServersTestJSON-71467556-project Aug 31 13:00:39.963722 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: method: > Aug 31 13:00:39.963722 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: exception: Instance 447f6c66-64aa-4e88-a317-27c64b4d82ea could not be found. Aug 31 13:00:39.963722 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: action_args: {'server_id': '447f6c66-64aa-4e88-a317-27c64b4d82ea'} Aug 31 13:00:39.964423 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:00:39.964423 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:00:39.964423 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 13:00:39.964423 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 13:00:39.964423 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 13:00:39.964423 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 13:00:39.964423 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 13:00:39.964423 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 13:00:39.964423 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 13:00:39.964423 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 13:00:39.964423 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 447f6c66-64aa-4e88-a317-27c64b4d82ea could not be found. Aug 31 13:00:39.964423 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:00:39.964423 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:00:39.964423 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:00:39.964423 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:00:39.964423 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:00:39.964423 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:00:39.964423 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:00:39.964423 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:00:39.964423 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:00:39.965489 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:00:39.965489 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 13:00:39.965489 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 13:00:39.965489 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 13:00:39.965489 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 13:00:39.965489 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 31 13:00:39.965489 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 31 13:00:39.965489 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 13:00:39.965489 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 13:00:39.965489 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 447f6c66-64aa-4e88-a317-27c64b4d82ea could not be found. Aug 31 13:00:39.965489 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:00:39.965489 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:00:39.965489 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:00:39.965489 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:00:39.965489 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:00:39.965489 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:00:39.965489 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:00:39.965489 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:00:39.965489 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 447f6c66-64aa-4e88-a317-27c64b4d82ea could not be found. Aug 31 13:00:39.965489 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:00:39.966565 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-8012ead6-d33c-4ea3-9694-136a4dd8bf11 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Returning 404 to user: Instance 447f6c66-64aa-4e88-a317-27c64b4d82ea could not be found. {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:00:39.966565 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-8012ead6-d33c-4ea3-9694-136a4dd8bf11 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036177 Aug 31 13:00:39.967868 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 103/220] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 31 13:00:39 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:00:40.106108 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-1dc2fcef-3286-4aaf-a0c2-c04e8679df81 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:40.116158 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-1dc2fcef-3286-4aaf-a0c2-c04e8679df81 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.185686 Aug 31 13:00:40.119872 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 118/221] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:39 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:00:41.138928 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-6ad7808a-9174-49dc-ba28-9c97369a86b4 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:41.139515 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-6ad7808a-9174-49dc-ba28-9c97369a86b4 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:41.147867 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6ad7808a-9174-49dc-ba28-9c97369a86b4 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:41.148649 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6ad7808a-9174-49dc-ba28-9c97369a86b4 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:41.149257 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6ad7808a-9174-49dc-ba28-9c97369a86b4 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:41.150208 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6ad7808a-9174-49dc-ba28-9c97369a86b4 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:41.150515 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6ad7808a-9174-49dc-ba28-9c97369a86b4 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:41.150918 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6ad7808a-9174-49dc-ba28-9c97369a86b4 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:41.208080 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-aaf413bc-45f3-4919-9b55-ed81c131e995 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:41.208565 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-aaf413bc-45f3-4919-9b55-ed81c131e995 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:41.226712 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-aaf413bc-45f3-4919-9b55-ed81c131e995 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:41.227261 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-aaf413bc-45f3-4919-9b55-ed81c131e995 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:41.227691 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-aaf413bc-45f3-4919-9b55-ed81c131e995 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:41.228417 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-aaf413bc-45f3-4919-9b55-ed81c131e995 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:41.228867 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-aaf413bc-45f3-4919-9b55-ed81c131e995 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:41.229292 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-aaf413bc-45f3-4919-9b55-ed81c131e995 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:41.247642 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.wsgi [None req-aaf413bc-45f3-4919-9b55-ed81c131e995 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] HTTP exception thrown: Instance 447f6c66-64aa-4e88-a317-27c64b4d82ea could not be found. Aug 31 13:00:41.249445 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-aaf413bc-45f3-4919-9b55-ed81c131e995 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Request method failure captured: Aug 31 13:00:41.249445 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: request: DELETE /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea HTTP/1.1 Aug 31 13:00:41.249445 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept: application/json Aug 31 13:00:41.249445 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept-Encoding: identity Aug 31 13:00:41.249445 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Connection: close Aug 31 13:00:41.249445 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Length: 0 Aug 31 13:00:41.249445 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Type: application/json Aug 31 13:00:41.249445 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Host: 10.222.0.58 Aug 31 13:00:41.249445 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Openstack-System-Scope: None Aug 31 13:00:41.249445 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: User-Agent: python-urllib3/1.26.12 Aug 31 13:00:41.249445 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Auth-Token: gAAAAABjD1sdH5JyTo1sJqAi524oYYOmFnlTaCeL-mTsmwb-R2SthDBSsyGy8ow_WtW1-gLeV_ndN3lhWzSMi3AK9M4FdDYDrsorzkh8Q9TYWbOVcMyAHu4jp7RNVCLgLP95w-aqO9DA4AkM37DTq2jH3dhx35xwTEx3iGTG0hyvBGtiFqM3VZ8 Aug 31 13:00:41.249445 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Id: None Aug 31 13:00:41.249445 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Name: None Aug 31 13:00:41.249445 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Identity-Status: Confirmed Aug 31 13:00:41.249445 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Is-Admin-Project: True Aug 31 13:00:41.249445 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Id: default Aug 31 13:00:41.249445 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Name: Default Aug 31 13:00:41.249445 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Id: f0eff3111a5847a68620fce8060df208 Aug 31 13:00:41.249445 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Name: tempest-DeleteServersTestJSON-71467556 Aug 31 13:00:41.249445 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Role: member,reader Aug 31 13:00:41.249445 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Roles: member,reader Aug 31 13:00:41.250543 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f0eff3111a5847a68620fce8060df208"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f0eff3111a5847a68620fce8060df208"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f0eff3111a5847a68620fce8060df208"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f0eff3111a5847a68620fce8060df208"}]}] Aug 31 13:00:41.250543 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant: tempest-DeleteServersTestJSON-71467556 Aug 31 13:00:41.250543 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Id: f0eff3111a5847a68620fce8060df208 Aug 31 13:00:41.250543 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Name: tempest-DeleteServersTestJSON-71467556 Aug 31 13:00:41.250543 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User: tempest-DeleteServersTestJSON-71467556-project Aug 31 13:00:41.250543 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Id: default Aug 31 13:00:41.250543 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Name: Default Aug 31 13:00:41.250543 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Id: 76b63adaf56e417cba603f908a8e451c Aug 31 13:00:41.250543 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Name: tempest-DeleteServersTestJSON-71467556-project Aug 31 13:00:41.250543 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: method: > Aug 31 13:00:41.250543 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: exception: Instance 447f6c66-64aa-4e88-a317-27c64b4d82ea could not be found. Aug 31 13:00:41.250543 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: action_args: {'id': '447f6c66-64aa-4e88-a317-27c64b4d82ea'} Aug 31 13:00:41.251169 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:00:41.251169 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:00:41.251169 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 13:00:41.251169 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 13:00:41.251169 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 13:00:41.251169 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 13:00:41.251169 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 13:00:41.251169 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 13:00:41.251169 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 13:00:41.251169 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 13:00:41.251169 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 447f6c66-64aa-4e88-a317-27c64b4d82ea could not be found. Aug 31 13:00:41.251169 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:00:41.251169 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:00:41.251169 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:00:41.251169 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:00:41.251169 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:00:41.251169 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:00:41.251169 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:00:41.251169 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:00:41.251169 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:00:41.252369 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:00:41.252369 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 13:00:41.252369 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 13:00:41.252369 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 13:00:41.252369 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 13:00:41.252369 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 13:00:41.252369 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 13:00:41.252369 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 13:00:41.252369 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 13:00:41.252369 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 447f6c66-64aa-4e88-a317-27c64b4d82ea could not be found. Aug 31 13:00:41.252369 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:00:41.252369 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:00:41.252369 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:00:41.252369 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:00:41.252369 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:00:41.252369 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:00:41.252369 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:00:41.252369 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:00:41.252369 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 447f6c66-64aa-4e88-a317-27c64b4d82ea could not be found. Aug 31 13:00:41.252369 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:00:41.253548 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-aaf413bc-45f3-4919-9b55-ed81c131e995 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Returning 404 to user: Instance 447f6c66-64aa-4e88-a317-27c64b4d82ea could not be found. {{(pid=120704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:00:41.253548 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-aaf413bc-45f3-4919-9b55-ed81c131e995 tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "DELETE /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 404 len: 111 microversion: 2.1 time: 0.046999 Aug 31 13:00:41.253548 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 119/222] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 31 13:00:41 2022] DELETE /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:00:41.262374 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-81fe6b55-d1a4-4b41-9cf4-11d5cb3717ad tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:41.263270 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-81fe6b55-d1a4-4b41-9cf4-11d5cb3717ad tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] [instance: 447f6c66-64aa-4e88-a317-27c64b4d82ea] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:41.269833 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-81fe6b55-d1a4-4b41-9cf4-11d5cb3717ad tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:41.270323 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-81fe6b55-d1a4-4b41-9cf4-11d5cb3717ad tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:41.270754 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-81fe6b55-d1a4-4b41-9cf4-11d5cb3717ad tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:41.271453 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-81fe6b55-d1a4-4b41-9cf4-11d5cb3717ad tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:41.271940 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-81fe6b55-d1a4-4b41-9cf4-11d5cb3717ad tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:41.272357 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-81fe6b55-d1a4-4b41-9cf4-11d5cb3717ad tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:41.286908 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.wsgi [None req-81fe6b55-d1a4-4b41-9cf4-11d5cb3717ad tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] HTTP exception thrown: Instance 447f6c66-64aa-4e88-a317-27c64b4d82ea could not be found. Aug 31 13:00:41.288494 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-81fe6b55-d1a4-4b41-9cf4-11d5cb3717ad tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Request method failure captured: Aug 31 13:00:41.288494 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: request: GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea HTTP/1.1 Aug 31 13:00:41.288494 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept: application/json Aug 31 13:00:41.288494 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept-Encoding: identity Aug 31 13:00:41.288494 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Connection: close Aug 31 13:00:41.288494 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Length: 0 Aug 31 13:00:41.288494 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Type: application/json Aug 31 13:00:41.288494 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Host: 10.222.0.58 Aug 31 13:00:41.288494 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Openstack-System-Scope: None Aug 31 13:00:41.288494 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: User-Agent: python-urllib3/1.26.12 Aug 31 13:00:41.288494 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Auth-Token: gAAAAABjD1sdH5JyTo1sJqAi524oYYOmFnlTaCeL-mTsmwb-R2SthDBSsyGy8ow_WtW1-gLeV_ndN3lhWzSMi3AK9M4FdDYDrsorzkh8Q9TYWbOVcMyAHu4jp7RNVCLgLP95w-aqO9DA4AkM37DTq2jH3dhx35xwTEx3iGTG0hyvBGtiFqM3VZ8 Aug 31 13:00:41.288494 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Id: None Aug 31 13:00:41.288494 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Name: None Aug 31 13:00:41.288494 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Identity-Status: Confirmed Aug 31 13:00:41.288494 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Is-Admin-Project: True Aug 31 13:00:41.288494 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Id: default Aug 31 13:00:41.288494 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Name: Default Aug 31 13:00:41.288494 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Id: f0eff3111a5847a68620fce8060df208 Aug 31 13:00:41.288494 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Name: tempest-DeleteServersTestJSON-71467556 Aug 31 13:00:41.288494 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Role: member,reader Aug 31 13:00:41.288494 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Roles: member,reader Aug 31 13:00:41.290327 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f0eff3111a5847a68620fce8060df208"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f0eff3111a5847a68620fce8060df208"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f0eff3111a5847a68620fce8060df208"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f0eff3111a5847a68620fce8060df208"}]}] Aug 31 13:00:41.290327 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant: tempest-DeleteServersTestJSON-71467556 Aug 31 13:00:41.290327 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Id: f0eff3111a5847a68620fce8060df208 Aug 31 13:00:41.290327 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Name: tempest-DeleteServersTestJSON-71467556 Aug 31 13:00:41.290327 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User: tempest-DeleteServersTestJSON-71467556-project Aug 31 13:00:41.290327 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Id: default Aug 31 13:00:41.290327 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Name: Default Aug 31 13:00:41.290327 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Id: 76b63adaf56e417cba603f908a8e451c Aug 31 13:00:41.290327 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Name: tempest-DeleteServersTestJSON-71467556-project Aug 31 13:00:41.290327 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: method: > Aug 31 13:00:41.290327 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: exception: Instance 447f6c66-64aa-4e88-a317-27c64b4d82ea could not be found. Aug 31 13:00:41.290327 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: action_args: {'id': '447f6c66-64aa-4e88-a317-27c64b4d82ea'} Aug 31 13:00:41.291272 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:00:41.291272 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:00:41.291272 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 13:00:41.291272 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 13:00:41.291272 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 13:00:41.291272 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 13:00:41.291272 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 13:00:41.291272 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 13:00:41.291272 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 13:00:41.291272 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 13:00:41.291272 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 447f6c66-64aa-4e88-a317-27c64b4d82ea could not be found. Aug 31 13:00:41.291272 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:00:41.291272 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:00:41.291272 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:00:41.291272 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:00:41.291272 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:00:41.291272 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:00:41.291272 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:00:41.291272 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:00:41.291272 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:00:41.293379 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:00:41.293379 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 13:00:41.293379 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 13:00:41.293379 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 13:00:41.293379 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 13:00:41.293379 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 13:00:41.293379 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 13:00:41.293379 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 447f6c66-64aa-4e88-a317-27c64b4d82ea could not be found. Aug 31 13:00:41.293379 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:00:41.293379 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:00:41.293379 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:00:41.293379 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:00:41.293379 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:00:41.293379 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:00:41.293379 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:00:41.293379 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:00:41.293379 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 447f6c66-64aa-4e88-a317-27c64b4d82ea could not be found. Aug 31 13:00:41.293379 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:00:41.295093 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-81fe6b55-d1a4-4b41-9cf4-11d5cb3717ad tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] Returning 404 to user: Instance 447f6c66-64aa-4e88-a317-27c64b4d82ea could not be found. {{(pid=120704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:00:41.295093 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-81fe6b55-d1a4-4b41-9cf4-11d5cb3717ad tempest-DeleteServersTestJSON-71467556 tempest-DeleteServersTestJSON-71467556-project] 10.222.0.58 "GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea" status: 404 len: 111 microversion: 2.1 time: 0.034724 Aug 31 13:00:41.295093 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 120/223] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:41 2022] GET /compute/v2.1/servers/447f6c66-64aa-4e88-a317-27c64b4d82ea => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:00:41.307535 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-6ad7808a-9174-49dc-ba28-9c97369a86b4 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:41.318190 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-6ad7808a-9174-49dc-ba28-9c97369a86b4 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.183840 Aug 31 13:00:41.318961 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 104/224] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:41 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:42.340139 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-6b27b569-a0ee-461e-bd61-bd4ecb3755d8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:42.340750 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-6b27b569-a0ee-461e-bd61-bd4ecb3755d8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:42.351040 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6b27b569-a0ee-461e-bd61-bd4ecb3755d8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:42.351520 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6b27b569-a0ee-461e-bd61-bd4ecb3755d8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:42.352035 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6b27b569-a0ee-461e-bd61-bd4ecb3755d8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:42.352922 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6b27b569-a0ee-461e-bd61-bd4ecb3755d8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:42.353435 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6b27b569-a0ee-461e-bd61-bd4ecb3755d8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:42.353824 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6b27b569-a0ee-461e-bd61-bd4ecb3755d8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:42.511616 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-6b27b569-a0ee-461e-bd61-bd4ecb3755d8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:42.522030 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-6b27b569-a0ee-461e-bd61-bd4ecb3755d8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.187187 Aug 31 13:00:42.523223 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 121/225] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:42 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:43.544817 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-a010cd4f-0356-4ce8-95e2-02ef036f8338 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:43.545546 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-a010cd4f-0356-4ce8-95e2-02ef036f8338 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:43.552007 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a010cd4f-0356-4ce8-95e2-02ef036f8338 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:43.552480 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a010cd4f-0356-4ce8-95e2-02ef036f8338 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:43.552902 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a010cd4f-0356-4ce8-95e2-02ef036f8338 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:43.553565 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a010cd4f-0356-4ce8-95e2-02ef036f8338 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:43.554180 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a010cd4f-0356-4ce8-95e2-02ef036f8338 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:43.554593 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a010cd4f-0356-4ce8-95e2-02ef036f8338 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:43.693014 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-a010cd4f-0356-4ce8-95e2-02ef036f8338 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:43.700809 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-a010cd4f-0356-4ce8-95e2-02ef036f8338 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.160043 Aug 31 13:00:43.701382 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 105/226] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:43 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:44.722740 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-ab989284-979a-4026-99b5-048c8c629a24 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:44.723605 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-ab989284-979a-4026-99b5-048c8c629a24 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:44.730225 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ab989284-979a-4026-99b5-048c8c629a24 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:44.730772 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ab989284-979a-4026-99b5-048c8c629a24 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:44.732394 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ab989284-979a-4026-99b5-048c8c629a24 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:44.733747 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ab989284-979a-4026-99b5-048c8c629a24 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:44.735215 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ab989284-979a-4026-99b5-048c8c629a24 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:44.736190 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ab989284-979a-4026-99b5-048c8c629a24 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:44.908030 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-ab989284-979a-4026-99b5-048c8c629a24 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:44.921210 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-ab989284-979a-4026-99b5-048c8c629a24 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.202734 Aug 31 13:00:44.922152 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 122/227] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:44 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:45.945917 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-37a1d38c-dc57-4b75-9a88-69a9dc9b5144 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:45.946506 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-37a1d38c-dc57-4b75-9a88-69a9dc9b5144 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:45.954466 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-37a1d38c-dc57-4b75-9a88-69a9dc9b5144 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:45.955139 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-37a1d38c-dc57-4b75-9a88-69a9dc9b5144 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:45.955592 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-37a1d38c-dc57-4b75-9a88-69a9dc9b5144 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:45.962273 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-37a1d38c-dc57-4b75-9a88-69a9dc9b5144 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:45.962806 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-37a1d38c-dc57-4b75-9a88-69a9dc9b5144 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:45.963543 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-37a1d38c-dc57-4b75-9a88-69a9dc9b5144 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:46.115718 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-37a1d38c-dc57-4b75-9a88-69a9dc9b5144 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:46.125955 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-37a1d38c-dc57-4b75-9a88-69a9dc9b5144 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.183825 Aug 31 13:00:46.126550 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 106/228] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:45 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:47.146705 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-727a94ba-d944-4f1f-a09b-2c991b39a1a1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:47.147347 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-727a94ba-d944-4f1f-a09b-2c991b39a1a1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:47.154240 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-727a94ba-d944-4f1f-a09b-2c991b39a1a1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:47.154719 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-727a94ba-d944-4f1f-a09b-2c991b39a1a1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:47.155155 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-727a94ba-d944-4f1f-a09b-2c991b39a1a1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:47.155875 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-727a94ba-d944-4f1f-a09b-2c991b39a1a1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:47.156328 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-727a94ba-d944-4f1f-a09b-2c991b39a1a1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:47.156760 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-727a94ba-d944-4f1f-a09b-2c991b39a1a1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:47.416405 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-727a94ba-d944-4f1f-a09b-2c991b39a1a1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:47.424821 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-727a94ba-d944-4f1f-a09b-2c991b39a1a1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.281989 Aug 31 13:00:47.425412 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 123/229] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:47 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:48.446557 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-a0076c52-d2d3-4930-8ca7-ed4cddd98207 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:48.447983 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-a0076c52-d2d3-4930-8ca7-ed4cddd98207 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:48.457556 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a0076c52-d2d3-4930-8ca7-ed4cddd98207 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:48.458434 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a0076c52-d2d3-4930-8ca7-ed4cddd98207 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:48.459016 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a0076c52-d2d3-4930-8ca7-ed4cddd98207 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:48.459892 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a0076c52-d2d3-4930-8ca7-ed4cddd98207 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:48.460480 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a0076c52-d2d3-4930-8ca7-ed4cddd98207 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:48.461064 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a0076c52-d2d3-4930-8ca7-ed4cddd98207 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:48.721336 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-a0076c52-d2d3-4930-8ca7-ed4cddd98207 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:48.731530 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-a0076c52-d2d3-4930-8ca7-ed4cddd98207 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.289007 Aug 31 13:00:48.732829 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 107/230] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:48 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:49.755633 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-d803a8df-1f6d-4b9d-9505-246b3e15f50f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:49.756242 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-d803a8df-1f6d-4b9d-9505-246b3e15f50f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:49.763338 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d803a8df-1f6d-4b9d-9505-246b3e15f50f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:49.763841 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d803a8df-1f6d-4b9d-9505-246b3e15f50f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:49.764661 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d803a8df-1f6d-4b9d-9505-246b3e15f50f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:49.766121 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d803a8df-1f6d-4b9d-9505-246b3e15f50f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:49.766575 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d803a8df-1f6d-4b9d-9505-246b3e15f50f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:49.767161 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d803a8df-1f6d-4b9d-9505-246b3e15f50f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:49.933883 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-d803a8df-1f6d-4b9d-9505-246b3e15f50f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:49.942501 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-d803a8df-1f6d-4b9d-9505-246b3e15f50f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.193134 Aug 31 13:00:49.944070 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 124/231] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:49 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:50.681754 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-4404eade-9560-45c6-8629-7e5c902950d6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Action: 'create', calling method: .version_select at 0x7f19515a9040>, body: {"keypair": {"name": "tempest-keypair-2030730088", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAMrWD0jPkfo+9f16FhKsDT0LK4Ngfb2NuQTUjjHitBrLP7m8zDTdgkEelRilnbNjuWMJE/eXskzjcEThQe/pbOw1TXqyrzNTN/qCjdieQelQha2JEKT9U85I9kgqgXyA=="}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:00:50.703613 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-4404eade-9560-45c6-8629-7e5c902950d6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Getting quotas for project fdf85a7b31004baf848842ad2f74cbf0. Resources: {'key_pairs'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 13:00:50.707685 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-4404eade-9560-45c6-8629-7e5c902950d6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Getting quotas for user ac2a50988be24e20be034777225d8106 and project fdf85a7b31004baf848842ad2f74cbf0. Resources: {'key_pairs'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 13:00:50.749005 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-4404eade-9560-45c6-8629-7e5c902950d6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.211555 Aug 31 13:00:50.750007 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 108/232] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 31 13:00:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:00:50.972056 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-0a4dfa10-b93f-4aba-982f-6962e1adbb15 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:50.972676 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-0a4dfa10-b93f-4aba-982f-6962e1adbb15 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:50.985089 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0a4dfa10-b93f-4aba-982f-6962e1adbb15 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:50.985656 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0a4dfa10-b93f-4aba-982f-6962e1adbb15 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:50.986925 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0a4dfa10-b93f-4aba-982f-6962e1adbb15 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:50.987066 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0a4dfa10-b93f-4aba-982f-6962e1adbb15 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:50.987627 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0a4dfa10-b93f-4aba-982f-6962e1adbb15 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:50.988180 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0a4dfa10-b93f-4aba-982f-6962e1adbb15 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:51.171777 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-0a4dfa10-b93f-4aba-982f-6962e1adbb15 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:51.179730 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-0a4dfa10-b93f-4aba-982f-6962e1adbb15 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.214665 Aug 31 13:00:51.180403 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 125/233] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:50 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:52.200657 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-41c33212-01d7-49ac-a7e5-a8f5a4f56eb4 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:52.201234 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-41c33212-01d7-49ac-a7e5-a8f5a4f56eb4 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:52.208469 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-41c33212-01d7-49ac-a7e5-a8f5a4f56eb4 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:52.209046 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-41c33212-01d7-49ac-a7e5-a8f5a4f56eb4 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:52.209638 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-41c33212-01d7-49ac-a7e5-a8f5a4f56eb4 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:52.210586 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-41c33212-01d7-49ac-a7e5-a8f5a4f56eb4 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:52.211184 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-41c33212-01d7-49ac-a7e5-a8f5a4f56eb4 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:52.211610 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-41c33212-01d7-49ac-a7e5-a8f5a4f56eb4 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:52.216514 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=87 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:52.357485 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-41c33212-01d7-49ac-a7e5-a8f5a4f56eb4 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:52.366199 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-41c33212-01d7-49ac-a7e5-a8f5a4f56eb4 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.169486 Aug 31 13:00:52.366960 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 109/234] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:52 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:00:52.444882 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-3eee5075-704e-413e-b169-731c1b672da2 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-914718407", "imageRef": "2aa55919-0f25-4e84-a2e1-f60acbe208b2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fb3a8ad8-8a96-4988-83d8-367334d3fb95"}], "security_groups": [{"name": "tempest-securitygroup--751925570"}], "key_name": "tempest-keypair-2030730088", "user_data": "}} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:00:52.564675 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.network.neutron [None req-3eee5075-704e-413e-b169-731c1b672da2 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] validate_networks() for [('fb3a8ad8-8a96-4988-83d8-367334d3fb95', None, None, None, None, None)] {{(pid=120704) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 13:00:52.972619 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.virt.hardware [None req-3eee5075-704e-413e-b169-731c1b672da2 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Flavor limits 0:0:0 {{(pid=120704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 13:00:52.973030 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.virt.hardware [None req-3eee5075-704e-413e-b169-731c1b672da2 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Image limits 0:0:0 {{(pid=120704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 13:00:52.973486 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.virt.hardware [None req-3eee5075-704e-413e-b169-731c1b672da2 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Flavor pref 0:0:0 {{(pid=120704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 13:00:52.973878 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.virt.hardware [None req-3eee5075-704e-413e-b169-731c1b672da2 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Image pref 0:0:0 {{(pid=120704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 13:00:52.974274 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.virt.hardware [None req-3eee5075-704e-413e-b169-731c1b672da2 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 13:00:52.982947 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3eee5075-704e-413e-b169-731c1b672da2 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:52.983409 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3eee5075-704e-413e-b169-731c1b672da2 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:52.983851 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3eee5075-704e-413e-b169-731c1b672da2 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:52.984577 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3eee5075-704e-413e-b169-731c1b672da2 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:52.985014 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3eee5075-704e-413e-b169-731c1b672da2 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:52.985428 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3eee5075-704e-413e-b169-731c1b672da2 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:53.003899 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.quota [None req-3eee5075-704e-413e-b169-731c1b672da2 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Getting quotas for project fdf85a7b31004baf848842ad2f74cbf0. Resources: {'instances', 'ram', 'cores'} {{(pid=120704) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 13:00:53.007602 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.quota [None req-3eee5075-704e-413e-b169-731c1b672da2 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Getting quotas for user ac2a50988be24e20be034777225d8106 and project fdf85a7b31004baf848842ad2f74cbf0. Resources: {'instances', 'ram', 'cores'} {{(pid=120704) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 13:00:53.019850 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-3eee5075-704e-413e-b169-731c1b672da2 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Going to run 1 instances... {{(pid=120704) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 13:00:53.022356 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-3eee5075-704e-413e-b169-731c1b672da2 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ba62b7ce-5880-4281-a5a4-020d70e5b16d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2aa55919-0f25-4e84-a2e1-f60acbe208b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120704) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 13:00:53.074433 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-3eee5075-704e-413e-b169-731c1b672da2 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.634440 Aug 31 13:00:53.075325 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 126/235] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 31 13:00:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 13:00:53.086750 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-2aebfeb2-b1ab-42a2-8b81-df65b4fa93b6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:53.087577 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-2aebfeb2-b1ab-42a2-8b81-df65b4fa93b6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ba62b7ce-5880-4281-a5a4-020d70e5b16d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:53.148350 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-2aebfeb2-b1ab-42a2-8b81-df65b4fa93b6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:53.157558 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-2aebfeb2-b1ab-42a2-8b81-df65b4fa93b6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d" status: 200 len: 1241 microversion: 2.1 time: 0.075198 Aug 31 13:00:53.158169 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 110/236] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:53 2022] GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d => generated 1241 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:53.386969 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-b0a0ec93-fc48-47a6-a1f9-730e8ce1fb7f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:53.387854 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-b0a0ec93-fc48-47a6-a1f9-730e8ce1fb7f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:53.394397 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b0a0ec93-fc48-47a6-a1f9-730e8ce1fb7f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:53.394922 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b0a0ec93-fc48-47a6-a1f9-730e8ce1fb7f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:53.395595 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b0a0ec93-fc48-47a6-a1f9-730e8ce1fb7f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:53.396956 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b0a0ec93-fc48-47a6-a1f9-730e8ce1fb7f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:53.397404 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b0a0ec93-fc48-47a6-a1f9-730e8ce1fb7f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:53.397907 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b0a0ec93-fc48-47a6-a1f9-730e8ce1fb7f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:53.551722 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-b0a0ec93-fc48-47a6-a1f9-730e8ce1fb7f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:53.564160 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-b0a0ec93-fc48-47a6-a1f9-730e8ce1fb7f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.180812 Aug 31 13:00:53.564831 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 127/237] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:53 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:54.178959 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-eed613fb-6923-4f78-93ae-f225720e1191 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:54.179860 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-eed613fb-6923-4f78-93ae-f225720e1191 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ba62b7ce-5880-4281-a5a4-020d70e5b16d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:54.186416 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-eed613fb-6923-4f78-93ae-f225720e1191 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:54.186968 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-eed613fb-6923-4f78-93ae-f225720e1191 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:54.187462 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-eed613fb-6923-4f78-93ae-f225720e1191 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:54.188252 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-eed613fb-6923-4f78-93ae-f225720e1191 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:54.188801 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-eed613fb-6923-4f78-93ae-f225720e1191 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:54.189291 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-eed613fb-6923-4f78-93ae-f225720e1191 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:54.252952 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-eed613fb-6923-4f78-93ae-f225720e1191 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:54.261705 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-eed613fb-6923-4f78-93ae-f225720e1191 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d" status: 200 len: 1245 microversion: 2.1 time: 0.087097 Aug 31 13:00:54.262816 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 111/238] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:54 2022] GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:54.586333 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-005a79e9-1531-4243-96ae-db6f82464b83 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:54.586988 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-005a79e9-1531-4243-96ae-db6f82464b83 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:54.594265 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-005a79e9-1531-4243-96ae-db6f82464b83 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:54.594752 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-005a79e9-1531-4243-96ae-db6f82464b83 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:54.595187 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-005a79e9-1531-4243-96ae-db6f82464b83 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:54.595946 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-005a79e9-1531-4243-96ae-db6f82464b83 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:54.596386 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-005a79e9-1531-4243-96ae-db6f82464b83 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:54.596825 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-005a79e9-1531-4243-96ae-db6f82464b83 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:54.732046 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-005a79e9-1531-4243-96ae-db6f82464b83 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:54.740331 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-005a79e9-1531-4243-96ae-db6f82464b83 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.158835 Aug 31 13:00:54.741109 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 128/239] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:54 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:55.287358 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-2e9711a7-fcb4-4b62-9822-ad90d0053d82 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:55.288960 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-2e9711a7-fcb4-4b62-9822-ad90d0053d82 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ba62b7ce-5880-4281-a5a4-020d70e5b16d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:55.296845 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2e9711a7-fcb4-4b62-9822-ad90d0053d82 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:55.297330 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2e9711a7-fcb4-4b62-9822-ad90d0053d82 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:55.298052 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2e9711a7-fcb4-4b62-9822-ad90d0053d82 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:55.299216 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2e9711a7-fcb4-4b62-9822-ad90d0053d82 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:55.299698 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2e9711a7-fcb4-4b62-9822-ad90d0053d82 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:55.300135 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2e9711a7-fcb4-4b62-9822-ad90d0053d82 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:55.362439 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-2e9711a7-fcb4-4b62-9822-ad90d0053d82 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:55.370383 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-2e9711a7-fcb4-4b62-9822-ad90d0053d82 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d" status: 200 len: 1245 microversion: 2.1 time: 0.089545 Aug 31 13:00:55.371114 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 112/240] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:55 2022] GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:55.761906 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-a2e4f81a-bf48-4073-a275-bf71028234cc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:55.762481 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-a2e4f81a-bf48-4073-a275-bf71028234cc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:55.769376 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a2e4f81a-bf48-4073-a275-bf71028234cc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:55.769852 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a2e4f81a-bf48-4073-a275-bf71028234cc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:55.770273 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a2e4f81a-bf48-4073-a275-bf71028234cc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:55.770949 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a2e4f81a-bf48-4073-a275-bf71028234cc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:55.771390 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a2e4f81a-bf48-4073-a275-bf71028234cc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:55.771801 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a2e4f81a-bf48-4073-a275-bf71028234cc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:55.912517 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-a2e4f81a-bf48-4073-a275-bf71028234cc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:55.921472 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-a2e4f81a-bf48-4073-a275-bf71028234cc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.163656 Aug 31 13:00:55.922192 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 129/241] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:55 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:56.391121 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-acb3295c-4615-43ef-afbf-036c5888d052 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:56.391737 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-acb3295c-4615-43ef-afbf-036c5888d052 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ba62b7ce-5880-4281-a5a4-020d70e5b16d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:56.399485 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-acb3295c-4615-43ef-afbf-036c5888d052 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:56.400004 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-acb3295c-4615-43ef-afbf-036c5888d052 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:56.400425 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-acb3295c-4615-43ef-afbf-036c5888d052 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:56.401123 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-acb3295c-4615-43ef-afbf-036c5888d052 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:56.401567 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-acb3295c-4615-43ef-afbf-036c5888d052 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:56.401978 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-acb3295c-4615-43ef-afbf-036c5888d052 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:56.471945 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-acb3295c-4615-43ef-afbf-036c5888d052 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:56.479868 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-acb3295c-4615-43ef-afbf-036c5888d052 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d" status: 200 len: 1245 microversion: 2.1 time: 0.092702 Aug 31 13:00:56.480465 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 113/242] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:56 2022] GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d => generated 1245 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:56.942534 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-ea8b1ac2-6493-467d-8a5c-4c44bb663e9d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:56.943188 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-ea8b1ac2-6493-467d-8a5c-4c44bb663e9d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:56.949828 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ea8b1ac2-6493-467d-8a5c-4c44bb663e9d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:56.950299 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ea8b1ac2-6493-467d-8a5c-4c44bb663e9d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:56.950733 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ea8b1ac2-6493-467d-8a5c-4c44bb663e9d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:56.951423 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ea8b1ac2-6493-467d-8a5c-4c44bb663e9d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:56.951898 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ea8b1ac2-6493-467d-8a5c-4c44bb663e9d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:56.952322 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ea8b1ac2-6493-467d-8a5c-4c44bb663e9d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:57.235427 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-ea8b1ac2-6493-467d-8a5c-4c44bb663e9d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:57.244015 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-ea8b1ac2-6493-467d-8a5c-4c44bb663e9d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.305361 Aug 31 13:00:57.244580 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 130/243] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:56 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:57.500745 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-ff3d21f1-38f9-4b64-a01b-96adcb3a7d7d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:57.501359 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-ff3d21f1-38f9-4b64-a01b-96adcb3a7d7d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ba62b7ce-5880-4281-a5a4-020d70e5b16d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:57.507452 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ff3d21f1-38f9-4b64-a01b-96adcb3a7d7d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:57.507984 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ff3d21f1-38f9-4b64-a01b-96adcb3a7d7d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:57.508648 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ff3d21f1-38f9-4b64-a01b-96adcb3a7d7d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:57.509476 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ff3d21f1-38f9-4b64-a01b-96adcb3a7d7d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:57.510048 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ff3d21f1-38f9-4b64-a01b-96adcb3a7d7d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:57.510424 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ff3d21f1-38f9-4b64-a01b-96adcb3a7d7d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:57.575722 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-ff3d21f1-38f9-4b64-a01b-96adcb3a7d7d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:57.583661 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-ff3d21f1-38f9-4b64-a01b-96adcb3a7d7d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d" status: 200 len: 1293 microversion: 2.1 time: 0.087132 Aug 31 13:00:57.584210 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 114/244] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:57 2022] GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:58.264817 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-40e116ea-a4de-4411-83b4-f5f1f633c5e6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:58.266139 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-40e116ea-a4de-4411-83b4-f5f1f633c5e6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:58.272765 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-40e116ea-a4de-4411-83b4-f5f1f633c5e6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:58.273240 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-40e116ea-a4de-4411-83b4-f5f1f633c5e6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:58.273665 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-40e116ea-a4de-4411-83b4-f5f1f633c5e6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:58.274356 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-40e116ea-a4de-4411-83b4-f5f1f633c5e6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:58.274798 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-40e116ea-a4de-4411-83b4-f5f1f633c5e6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:58.275208 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-40e116ea-a4de-4411-83b4-f5f1f633c5e6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:58.411247 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-40e116ea-a4de-4411-83b4-f5f1f633c5e6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:58.420901 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-40e116ea-a4de-4411-83b4-f5f1f633c5e6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.159916 Aug 31 13:00:58.421461 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 131/245] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:58 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:58.605496 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-458d6308-5ca8-45f0-860a-bc14b6a4d630 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:58.606059 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-458d6308-5ca8-45f0-860a-bc14b6a4d630 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ba62b7ce-5880-4281-a5a4-020d70e5b16d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:58.612722 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-458d6308-5ca8-45f0-860a-bc14b6a4d630 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:58.613277 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-458d6308-5ca8-45f0-860a-bc14b6a4d630 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:58.613771 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-458d6308-5ca8-45f0-860a-bc14b6a4d630 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:58.614554 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-458d6308-5ca8-45f0-860a-bc14b6a4d630 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:58.615068 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-458d6308-5ca8-45f0-860a-bc14b6a4d630 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:58.615532 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-458d6308-5ca8-45f0-860a-bc14b6a4d630 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:58.708379 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-458d6308-5ca8-45f0-860a-bc14b6a4d630 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:58.717192 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-458d6308-5ca8-45f0-860a-bc14b6a4d630 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d" status: 200 len: 1299 microversion: 2.1 time: 0.115589 Aug 31 13:00:58.717944 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 115/246] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:58 2022] GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d => generated 1299 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:59.441213 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-951363a2-c341-47bb-af35-d773977fa8f3 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:59.441799 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-951363a2-c341-47bb-af35-d773977fa8f3 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:59.448498 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-951363a2-c341-47bb-af35-d773977fa8f3 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:59.448960 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-951363a2-c341-47bb-af35-d773977fa8f3 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:59.449606 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-951363a2-c341-47bb-af35-d773977fa8f3 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:59.450301 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-951363a2-c341-47bb-af35-d773977fa8f3 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:59.450737 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-951363a2-c341-47bb-af35-d773977fa8f3 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:59.451175 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-951363a2-c341-47bb-af35-d773977fa8f3 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:59.683332 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-951363a2-c341-47bb-af35-d773977fa8f3 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:59.692386 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-951363a2-c341-47bb-af35-d773977fa8f3 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.255059 Aug 31 13:00:59.692957 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 132/247] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:59 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:59.738595 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-4808088a-6457-4a03-aba9-75462e8b36f5 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:59.739205 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-4808088a-6457-4a03-aba9-75462e8b36f5 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ba62b7ce-5880-4281-a5a4-020d70e5b16d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:59.745551 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4808088a-6457-4a03-aba9-75462e8b36f5 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:59.746232 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4808088a-6457-4a03-aba9-75462e8b36f5 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:59.746672 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4808088a-6457-4a03-aba9-75462e8b36f5 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:59.747334 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4808088a-6457-4a03-aba9-75462e8b36f5 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:59.747768 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4808088a-6457-4a03-aba9-75462e8b36f5 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:59.748277 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4808088a-6457-4a03-aba9-75462e8b36f5 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:59.856569 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-96012c6a-aa7e-4725-9ff1-43a4781883c4 req-bbc46d74-e5ad-469f-98f5-d512ef6d92dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba62b7ce-5880-4281-a5a4-020d70e5b16d", "tag": "aa4db9c7-a72c-4448-8fdd-44507dfa381d"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:00:59.896158 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-96012c6a-aa7e-4725-9ff1-43a4781883c4 req-bbc46d74-e5ad-469f-98f5-d512ef6d92dc service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:59.896158 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-96012c6a-aa7e-4725-9ff1-43a4781883c4 req-bbc46d74-e5ad-469f-98f5-d512ef6d92dc service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:59.896158 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-96012c6a-aa7e-4725-9ff1-43a4781883c4 req-bbc46d74-e5ad-469f-98f5-d512ef6d92dc service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:59.924904 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-96012c6a-aa7e-4725-9ff1-43a4781883c4 req-bbc46d74-e5ad-469f-98f5-d512ef6d92dc service nova] Creating event network-changed:aa4db9c7-a72c-4448-8fdd-44507dfa381d for instance ba62b7ce-5880-4281-a5a4-020d70e5b16d on hv-cinder-85442 Aug 31 13:00:59.933130 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-96012c6a-aa7e-4725-9ff1-43a4781883c4 req-bbc46d74-e5ad-469f-98f5-d512ef6d92dc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090152 Aug 31 13:00:59.934059 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 133/248] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:00:59.977955 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-4808088a-6457-4a03-aba9-75462e8b36f5 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:59.986740 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-4808088a-6457-4a03-aba9-75462e8b36f5 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d" status: 200 len: 1366 microversion: 2.1 time: 0.251956 Aug 31 13:00:59.987413 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 116/249] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:59 2022] GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d => generated 1366 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:00.714121 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-d85dd88d-0417-4d9e-965b-a09d76e9f2ce tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:00.714857 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-d85dd88d-0417-4d9e-965b-a09d76e9f2ce tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:00.722022 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d85dd88d-0417-4d9e-965b-a09d76e9f2ce tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:00.722532 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d85dd88d-0417-4d9e-965b-a09d76e9f2ce tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:00.722974 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d85dd88d-0417-4d9e-965b-a09d76e9f2ce tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:00.723687 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d85dd88d-0417-4d9e-965b-a09d76e9f2ce tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:00.724187 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d85dd88d-0417-4d9e-965b-a09d76e9f2ce tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:00.724619 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d85dd88d-0417-4d9e-965b-a09d76e9f2ce tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:00.864221 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-d85dd88d-0417-4d9e-965b-a09d76e9f2ce tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:00.875299 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-d85dd88d-0417-4d9e-965b-a09d76e9f2ce tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.165979 Aug 31 13:01:00.876136 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 134/250] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:00 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:01.008167 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-200c5a16-3d64-4ca7-8237-de368522c485 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:01.008770 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-200c5a16-3d64-4ca7-8237-de368522c485 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ba62b7ce-5880-4281-a5a4-020d70e5b16d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:01.015176 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-200c5a16-3d64-4ca7-8237-de368522c485 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:01.016036 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-200c5a16-3d64-4ca7-8237-de368522c485 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:01.016536 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-200c5a16-3d64-4ca7-8237-de368522c485 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:01.017266 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-200c5a16-3d64-4ca7-8237-de368522c485 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:01.017707 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-200c5a16-3d64-4ca7-8237-de368522c485 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:01.018121 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-200c5a16-3d64-4ca7-8237-de368522c485 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:01.152777 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-200c5a16-3d64-4ca7-8237-de368522c485 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:01.161093 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-200c5a16-3d64-4ca7-8237-de368522c485 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d" status: 200 len: 1366 microversion: 2.1 time: 0.156974 Aug 31 13:01:01.161827 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 117/251] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:01 2022] GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:01.901083 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-8c36266e-e810-409a-b7f6-b1a3800bcee0 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:01.902147 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-8c36266e-e810-409a-b7f6-b1a3800bcee0 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:01.905228 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:01.911931 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8c36266e-e810-409a-b7f6-b1a3800bcee0 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:01.912526 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8c36266e-e810-409a-b7f6-b1a3800bcee0 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:01.913061 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8c36266e-e810-409a-b7f6-b1a3800bcee0 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:01.914257 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8c36266e-e810-409a-b7f6-b1a3800bcee0 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:01.914808 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8c36266e-e810-409a-b7f6-b1a3800bcee0 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:01.915325 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8c36266e-e810-409a-b7f6-b1a3800bcee0 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:02.057237 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-8c36266e-e810-409a-b7f6-b1a3800bcee0 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:02.065334 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-8c36266e-e810-409a-b7f6-b1a3800bcee0 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.170922 Aug 31 13:01:02.065891 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 135/252] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:01 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:02.186586 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-80bb5c4e-e2e7-493a-8cae-efd3e24bcd9c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:02.187564 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-80bb5c4e-e2e7-493a-8cae-efd3e24bcd9c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ba62b7ce-5880-4281-a5a4-020d70e5b16d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:02.197874 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-80bb5c4e-e2e7-493a-8cae-efd3e24bcd9c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:02.198669 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-80bb5c4e-e2e7-493a-8cae-efd3e24bcd9c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:02.199295 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-80bb5c4e-e2e7-493a-8cae-efd3e24bcd9c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:02.200023 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-80bb5c4e-e2e7-493a-8cae-efd3e24bcd9c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:02.200467 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-80bb5c4e-e2e7-493a-8cae-efd3e24bcd9c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:02.200887 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-80bb5c4e-e2e7-493a-8cae-efd3e24bcd9c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:02.329721 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-80bb5c4e-e2e7-493a-8cae-efd3e24bcd9c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:02.337825 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-80bb5c4e-e2e7-493a-8cae-efd3e24bcd9c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d" status: 200 len: 1366 microversion: 2.1 time: 0.157793 Aug 31 13:01:02.338403 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 118/253] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:02 2022] GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:03.088099 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-e2414e6d-af28-4a3e-af06-2f2cd9e0ac6b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:03.090171 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-e2414e6d-af28-4a3e-af06-2f2cd9e0ac6b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:03.100896 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell0:SELECT=2 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:03.102156 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell0:SELECT=6 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:03.104071 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e2414e6d-af28-4a3e-af06-2f2cd9e0ac6b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:03.105427 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e2414e6d-af28-4a3e-af06-2f2cd9e0ac6b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:03.106123 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e2414e6d-af28-4a3e-af06-2f2cd9e0ac6b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:03.107227 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e2414e6d-af28-4a3e-af06-2f2cd9e0ac6b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:03.107675 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e2414e6d-af28-4a3e-af06-2f2cd9e0ac6b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:03.108416 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e2414e6d-af28-4a3e-af06-2f2cd9e0ac6b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:03.285461 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-e2414e6d-af28-4a3e-af06-2f2cd9e0ac6b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:03.295194 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-e2414e6d-af28-4a3e-af06-2f2cd9e0ac6b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.212289 Aug 31 13:01:03.296399 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 136/254] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:03 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:03.358724 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-6eed4263-1db2-4892-933f-4c1bc1ee62d8 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:03.359477 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-6eed4263-1db2-4892-933f-4c1bc1ee62d8 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ba62b7ce-5880-4281-a5a4-020d70e5b16d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:03.361347 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=6 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:03.374588 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6eed4263-1db2-4892-933f-4c1bc1ee62d8 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:03.375225 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6eed4263-1db2-4892-933f-4c1bc1ee62d8 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:03.375713 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6eed4263-1db2-4892-933f-4c1bc1ee62d8 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:03.376730 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6eed4263-1db2-4892-933f-4c1bc1ee62d8 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:03.377152 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6eed4263-1db2-4892-933f-4c1bc1ee62d8 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:03.377603 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6eed4263-1db2-4892-933f-4c1bc1ee62d8 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:03.726747 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-6eed4263-1db2-4892-933f-4c1bc1ee62d8 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:03.734474 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-6eed4263-1db2-4892-933f-4c1bc1ee62d8 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d" status: 200 len: 1366 microversion: 2.1 time: 0.379685 Aug 31 13:01:03.735032 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 119/255] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:03 2022] GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d => generated 1366 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:04.317517 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-104f3c62-96b6-4e6a-aa48-75b853c5b43c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:04.318219 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-104f3c62-96b6-4e6a-aa48-75b853c5b43c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:04.326056 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-104f3c62-96b6-4e6a-aa48-75b853c5b43c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:04.326537 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-104f3c62-96b6-4e6a-aa48-75b853c5b43c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:04.326968 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-104f3c62-96b6-4e6a-aa48-75b853c5b43c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:04.327706 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-104f3c62-96b6-4e6a-aa48-75b853c5b43c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:04.328192 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-104f3c62-96b6-4e6a-aa48-75b853c5b43c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:04.328604 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-104f3c62-96b6-4e6a-aa48-75b853c5b43c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:04.347677 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell1:SELECT=100 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:04.470146 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-104f3c62-96b6-4e6a-aa48-75b853c5b43c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:04.478173 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-104f3c62-96b6-4e6a-aa48-75b853c5b43c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.165305 Aug 31 13:01:04.478762 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 137/256] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:04 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:04.755344 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b9a9a69d-6de7-4f38-b5de-f4e0c6ff7c2f tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:04.755981 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b9a9a69d-6de7-4f38-b5de-f4e0c6ff7c2f tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ba62b7ce-5880-4281-a5a4-020d70e5b16d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:04.762113 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b9a9a69d-6de7-4f38-b5de-f4e0c6ff7c2f tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:04.762638 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b9a9a69d-6de7-4f38-b5de-f4e0c6ff7c2f tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:04.763076 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b9a9a69d-6de7-4f38-b5de-f4e0c6ff7c2f tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:04.763753 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b9a9a69d-6de7-4f38-b5de-f4e0c6ff7c2f tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:04.764215 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b9a9a69d-6de7-4f38-b5de-f4e0c6ff7c2f tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:04.764627 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b9a9a69d-6de7-4f38-b5de-f4e0c6ff7c2f tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:04.892720 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-b9a9a69d-6de7-4f38-b5de-f4e0c6ff7c2f tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:04.901888 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b9a9a69d-6de7-4f38-b5de-f4e0c6ff7c2f tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d" status: 200 len: 1366 microversion: 2.1 time: 0.150465 Aug 31 13:01:04.902421 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 120/257] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:04 2022] GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:05.500837 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-54e13514-3761-4ccc-ada3-d8ebe1115f2b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:05.501579 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-54e13514-3761-4ccc-ada3-d8ebe1115f2b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:05.509128 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-54e13514-3761-4ccc-ada3-d8ebe1115f2b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:05.509586 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-54e13514-3761-4ccc-ada3-d8ebe1115f2b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:05.510241 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-54e13514-3761-4ccc-ada3-d8ebe1115f2b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:05.510939 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-54e13514-3761-4ccc-ada3-d8ebe1115f2b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:05.511373 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-54e13514-3761-4ccc-ada3-d8ebe1115f2b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:05.511786 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-54e13514-3761-4ccc-ada3-d8ebe1115f2b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:05.662876 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-54e13514-3761-4ccc-ada3-d8ebe1115f2b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:05.670942 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-54e13514-3761-4ccc-ada3-d8ebe1115f2b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.174433 Aug 31 13:01:05.671524 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 138/258] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:05 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:05.924449 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-df3d058a-56b0-4fb2-ad01-a99a0c33de47 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:05.925613 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-df3d058a-56b0-4fb2-ad01-a99a0c33de47 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ba62b7ce-5880-4281-a5a4-020d70e5b16d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:05.932292 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-df3d058a-56b0-4fb2-ad01-a99a0c33de47 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:05.932835 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-df3d058a-56b0-4fb2-ad01-a99a0c33de47 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:05.933469 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-df3d058a-56b0-4fb2-ad01-a99a0c33de47 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:05.934160 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-df3d058a-56b0-4fb2-ad01-a99a0c33de47 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:05.934601 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-df3d058a-56b0-4fb2-ad01-a99a0c33de47 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:05.935016 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-df3d058a-56b0-4fb2-ad01-a99a0c33de47 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:06.079610 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-df3d058a-56b0-4fb2-ad01-a99a0c33de47 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:06.089953 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-df3d058a-56b0-4fb2-ad01-a99a0c33de47 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d" status: 200 len: 1366 microversion: 2.1 time: 0.164511 Aug 31 13:01:06.092832 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 121/259] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:05 2022] GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:06.692046 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-2283fbca-45f8-4079-8422-a9c2b3bdf5a1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:06.692654 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-2283fbca-45f8-4079-8422-a9c2b3bdf5a1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:06.699298 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2283fbca-45f8-4079-8422-a9c2b3bdf5a1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:06.699775 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2283fbca-45f8-4079-8422-a9c2b3bdf5a1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:06.700295 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2283fbca-45f8-4079-8422-a9c2b3bdf5a1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:06.701002 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2283fbca-45f8-4079-8422-a9c2b3bdf5a1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:06.701448 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2283fbca-45f8-4079-8422-a9c2b3bdf5a1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:06.701868 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2283fbca-45f8-4079-8422-a9c2b3bdf5a1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:06.850642 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-2283fbca-45f8-4079-8422-a9c2b3bdf5a1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:06.858846 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-2283fbca-45f8-4079-8422-a9c2b3bdf5a1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.170742 Aug 31 13:01:06.859448 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 139/260] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:06 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:07.112924 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-ab8bf63e-52c5-4c45-a849-b19e174a854c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:07.113501 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-ab8bf63e-52c5-4c45-a849-b19e174a854c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ba62b7ce-5880-4281-a5a4-020d70e5b16d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:07.120518 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ab8bf63e-52c5-4c45-a849-b19e174a854c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:07.121114 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ab8bf63e-52c5-4c45-a849-b19e174a854c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:07.121644 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ab8bf63e-52c5-4c45-a849-b19e174a854c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:07.122474 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ab8bf63e-52c5-4c45-a849-b19e174a854c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:07.122920 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ab8bf63e-52c5-4c45-a849-b19e174a854c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:07.123463 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ab8bf63e-52c5-4c45-a849-b19e174a854c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:07.259143 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-ab8bf63e-52c5-4c45-a849-b19e174a854c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:07.268918 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-ab8bf63e-52c5-4c45-a849-b19e174a854c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d" status: 200 len: 1366 microversion: 2.1 time: 0.159632 Aug 31 13:01:07.269630 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 122/261] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:07 2022] GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:07.881003 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-cc09465c-0055-42b5-9b0d-39d736fd6678 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:07.881604 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-cc09465c-0055-42b5-9b0d-39d736fd6678 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:07.888773 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cc09465c-0055-42b5-9b0d-39d736fd6678 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:07.889248 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cc09465c-0055-42b5-9b0d-39d736fd6678 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:07.889674 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cc09465c-0055-42b5-9b0d-39d736fd6678 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:07.890366 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cc09465c-0055-42b5-9b0d-39d736fd6678 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:07.890805 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cc09465c-0055-42b5-9b0d-39d736fd6678 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:07.891219 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cc09465c-0055-42b5-9b0d-39d736fd6678 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:08.026762 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-cc09465c-0055-42b5-9b0d-39d736fd6678 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:08.035634 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-cc09465c-0055-42b5-9b0d-39d736fd6678 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.158530 Aug 31 13:01:08.039751 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 140/262] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:07 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:08.290442 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-6ffc4e5d-4484-4bd1-9a23-b410afac1e0a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:08.290983 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-6ffc4e5d-4484-4bd1-9a23-b410afac1e0a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ba62b7ce-5880-4281-a5a4-020d70e5b16d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:08.297254 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6ffc4e5d-4484-4bd1-9a23-b410afac1e0a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:08.297733 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6ffc4e5d-4484-4bd1-9a23-b410afac1e0a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:08.298280 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6ffc4e5d-4484-4bd1-9a23-b410afac1e0a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:08.299361 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6ffc4e5d-4484-4bd1-9a23-b410afac1e0a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:08.299361 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6ffc4e5d-4484-4bd1-9a23-b410afac1e0a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:08.300061 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6ffc4e5d-4484-4bd1-9a23-b410afac1e0a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:08.440621 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-6ffc4e5d-4484-4bd1-9a23-b410afac1e0a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:08.448672 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-6ffc4e5d-4484-4bd1-9a23-b410afac1e0a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d" status: 200 len: 1366 microversion: 2.1 time: 0.162999 Aug 31 13:01:08.449286 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 123/263] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:08 2022] GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:09.059359 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-5f89a807-95ad-4dfa-b84a-141605af2dd5 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:09.059913 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-5f89a807-95ad-4dfa-b84a-141605af2dd5 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:09.068123 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5f89a807-95ad-4dfa-b84a-141605af2dd5 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:09.068610 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5f89a807-95ad-4dfa-b84a-141605af2dd5 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:09.069019 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5f89a807-95ad-4dfa-b84a-141605af2dd5 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:09.070092 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5f89a807-95ad-4dfa-b84a-141605af2dd5 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:09.070571 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5f89a807-95ad-4dfa-b84a-141605af2dd5 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:09.070994 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5f89a807-95ad-4dfa-b84a-141605af2dd5 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:09.297090 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-5f89a807-95ad-4dfa-b84a-141605af2dd5 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:09.307170 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-5f89a807-95ad-4dfa-b84a-141605af2dd5 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.251704 Aug 31 13:01:09.310939 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 141/264] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:09 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:09.472771 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-89756c84-db1c-4a5e-af76-4037e39f6d95 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:09.474105 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-89756c84-db1c-4a5e-af76-4037e39f6d95 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ba62b7ce-5880-4281-a5a4-020d70e5b16d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:09.481620 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:09.484627 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-89756c84-db1c-4a5e-af76-4037e39f6d95 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:09.485388 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-89756c84-db1c-4a5e-af76-4037e39f6d95 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:09.486219 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-89756c84-db1c-4a5e-af76-4037e39f6d95 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:09.487699 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-89756c84-db1c-4a5e-af76-4037e39f6d95 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:09.488363 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-89756c84-db1c-4a5e-af76-4037e39f6d95 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:09.489550 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-89756c84-db1c-4a5e-af76-4037e39f6d95 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:09.843033 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-89756c84-db1c-4a5e-af76-4037e39f6d95 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:09.853046 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-89756c84-db1c-4a5e-af76-4037e39f6d95 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d" status: 200 len: 1366 microversion: 2.1 time: 0.386164 Aug 31 13:01:09.855967 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 124/265] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:09 2022] GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d => generated 1366 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:10.330409 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-59194380-f253-4091-aec8-81bded468f48 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:10.330984 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-59194380-f253-4091-aec8-81bded468f48 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:10.338434 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-59194380-f253-4091-aec8-81bded468f48 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:10.339472 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-59194380-f253-4091-aec8-81bded468f48 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:10.340157 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-59194380-f253-4091-aec8-81bded468f48 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:10.341092 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-59194380-f253-4091-aec8-81bded468f48 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:10.341617 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-59194380-f253-4091-aec8-81bded468f48 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:10.342212 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-59194380-f253-4091-aec8-81bded468f48 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:10.484874 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-59194380-f253-4091-aec8-81bded468f48 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:10.493550 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-59194380-f253-4091-aec8-81bded468f48 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.168885 Aug 31 13:01:10.494566 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 142/266] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:10 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:10.571225 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-c48e81ac-cc06-4f4b-a7a4-c42f6778790c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1989321451", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-602751871", "security_groups": [{"name": "tempest-secgroup-smoke-1513377233"}], "networks": [{"uuid": "9f141728-fb2a-4451-87bb-a02fcdbafd4f"}], "block_device_mapping_v2": [{"uuid": "6bd384dc-9150-469a-8421-afb1307b2a38", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:01:10.732962 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.network.neutron [None req-c48e81ac-cc06-4f4b-a7a4-c42f6778790c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] validate_networks() for [('9f141728-fb2a-4451-87bb-a02fcdbafd4f', None, None, None, None, None)] {{(pid=120705) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 13:01:10.876820 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-e0005b73-a83f-4996-b0f8-abfcca85731a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:10.877819 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-e0005b73-a83f-4996-b0f8-abfcca85731a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ba62b7ce-5880-4281-a5a4-020d70e5b16d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:10.884150 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e0005b73-a83f-4996-b0f8-abfcca85731a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:10.884387 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e0005b73-a83f-4996-b0f8-abfcca85731a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:10.884818 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e0005b73-a83f-4996-b0f8-abfcca85731a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:10.885515 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e0005b73-a83f-4996-b0f8-abfcca85731a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:10.885958 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e0005b73-a83f-4996-b0f8-abfcca85731a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:10.886373 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e0005b73-a83f-4996-b0f8-abfcca85731a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:11.145075 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-e0005b73-a83f-4996-b0f8-abfcca85731a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:11.153659 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-e0005b73-a83f-4996-b0f8-abfcca85731a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d" status: 200 len: 1366 microversion: 2.1 time: 0.280824 Aug 31 13:01:11.168095 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 143/267] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:10 2022] GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d => generated 1366 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:11.310788 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-c48e81ac-cc06-4f4b-a7a4-c42f6778790c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Flavor limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 13:01:11.311312 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-c48e81ac-cc06-4f4b-a7a4-c42f6778790c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Image limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 13:01:11.311844 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-c48e81ac-cc06-4f4b-a7a4-c42f6778790c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Flavor pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 13:01:11.312313 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-c48e81ac-cc06-4f4b-a7a4-c42f6778790c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Image pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 13:01:11.312842 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-c48e81ac-cc06-4f4b-a7a4-c42f6778790c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 13:01:11.327928 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c48e81ac-cc06-4f4b-a7a4-c42f6778790c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:11.328402 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c48e81ac-cc06-4f4b-a7a4-c42f6778790c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:11.328908 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c48e81ac-cc06-4f4b-a7a4-c42f6778790c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:11.329770 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c48e81ac-cc06-4f4b-a7a4-c42f6778790c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:11.331037 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c48e81ac-cc06-4f4b-a7a4-c42f6778790c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:11.332464 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c48e81ac-cc06-4f4b-a7a4-c42f6778790c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:11.353659 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-c48e81ac-cc06-4f4b-a7a4-c42f6778790c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Getting quotas for project 3859db006a384cd9b5ba39ca7e6fb922. Resources: {'instances', 'ram', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 13:01:11.358438 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-c48e81ac-cc06-4f4b-a7a4-c42f6778790c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Getting quotas for user a961ae2bcbe24018befc9b9a9e6d288e and project 3859db006a384cd9b5ba39ca7e6fb922. Resources: {'instances', 'ram', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 13:01:11.443437 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-c48e81ac-cc06-4f4b-a7a4-c42f6778790c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Going to run 1 instances... {{(pid=120705) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 13:01:11.445744 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-c48e81ac-cc06-4f4b-a7a4-c42f6778790c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6bd384dc-9150-469a-8421-afb1307b2a38',volume_size=None,volume_type=None)] {{(pid=120705) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 13:01:11.516124 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-4b186fc9-7d3b-4de1-bfdc-7a5b73b6d0d7 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:11.516730 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-4b186fc9-7d3b-4de1-bfdc-7a5b73b6d0d7 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:11.530696 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4b186fc9-7d3b-4de1-bfdc-7a5b73b6d0d7 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:11.531556 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4b186fc9-7d3b-4de1-bfdc-7a5b73b6d0d7 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:11.531556 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4b186fc9-7d3b-4de1-bfdc-7a5b73b6d0d7 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:11.532225 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4b186fc9-7d3b-4de1-bfdc-7a5b73b6d0d7 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:11.532684 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4b186fc9-7d3b-4de1-bfdc-7a5b73b6d0d7 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:11.533701 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4b186fc9-7d3b-4de1-bfdc-7a5b73b6d0d7 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:11.733580 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-c48e81ac-cc06-4f4b-a7a4-c42f6778790c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.167415 Aug 31 13:01:11.734241 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 125/268] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 31 13:01:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 1169 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 13:01:11.771037 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-5242bbd3-0f61-4dcc-8abd-f3e8d5fc9929 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:11.776478 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-5242bbd3-0f61-4dcc-8abd-f3e8d5fc9929 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:11.902983 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-5242bbd3-0f61-4dcc-8abd-f3e8d5fc9929 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:11.920563 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-5242bbd3-0f61-4dcc-8abd-f3e8d5fc9929 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1088 microversion: 2.1 time: 0.176470 Aug 31 13:01:11.921677 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 126/269] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:11 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1088 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:01:11.932429 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-b12a3cfb-7a35-4e6b-a887-23ab6cad938b req-4a9a68f8-82f9-4f5c-a940-81c166445475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba62b7ce-5880-4281-a5a4-020d70e5b16d", "name": "network-vif-plugged", "status": "completed", "tag": "aa4db9c7-a72c-4448-8fdd-44507dfa381d"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:01:11.964055 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-b12a3cfb-7a35-4e6b-a887-23ab6cad938b req-4a9a68f8-82f9-4f5c-a940-81c166445475 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:11.964055 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-b12a3cfb-7a35-4e6b-a887-23ab6cad938b req-4a9a68f8-82f9-4f5c-a940-81c166445475 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:11.964463 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-b12a3cfb-7a35-4e6b-a887-23ab6cad938b req-4a9a68f8-82f9-4f5c-a940-81c166445475 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:11.999529 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-4b186fc9-7d3b-4de1-bfdc-7a5b73b6d0d7 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:12.005258 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-b12a3cfb-7a35-4e6b-a887-23ab6cad938b req-4a9a68f8-82f9-4f5c-a940-81c166445475 service nova] Creating event network-vif-plugged:aa4db9c7-a72c-4448-8fdd-44507dfa381d for instance ba62b7ce-5880-4281-a5a4-020d70e5b16d on hv-cinder-85442 Aug 31 13:01:12.012888 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-b12a3cfb-7a35-4e6b-a887-23ab6cad938b req-4a9a68f8-82f9-4f5c-a940-81c166445475 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088734 Aug 31 13:01:12.013068 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-4b186fc9-7d3b-4de1-bfdc-7a5b73b6d0d7 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.496251 Aug 31 13:01:12.013782 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 144/270] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:11 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:01:12.014487 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 127/271] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:01:12.186130 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-77673e01-b126-4fac-b510-566ea8e47260 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:12.187097 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-77673e01-b126-4fac-b510-566ea8e47260 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ba62b7ce-5880-4281-a5a4-020d70e5b16d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:12.201032 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-77673e01-b126-4fac-b510-566ea8e47260 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:12.201678 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-77673e01-b126-4fac-b510-566ea8e47260 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:12.202214 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-77673e01-b126-4fac-b510-566ea8e47260 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:12.203120 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-77673e01-b126-4fac-b510-566ea8e47260 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:12.203753 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-77673e01-b126-4fac-b510-566ea8e47260 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:12.204507 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-77673e01-b126-4fac-b510-566ea8e47260 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:12.372914 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-77673e01-b126-4fac-b510-566ea8e47260 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:12.381052 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-77673e01-b126-4fac-b510-566ea8e47260 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d" status: 200 len: 1366 microversion: 2.1 time: 0.198800 Aug 31 13:01:12.383740 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 145/272] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:12 2022] GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:12.954228 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-ea80db7b-54e2-4e22-91e3-5708f15502c6 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:12.956201 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-ea80db7b-54e2-4e22-91e3-5708f15502c6 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:12.979875 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ea80db7b-54e2-4e22-91e3-5708f15502c6 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:12.980526 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ea80db7b-54e2-4e22-91e3-5708f15502c6 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:12.981172 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ea80db7b-54e2-4e22-91e3-5708f15502c6 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:12.982421 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ea80db7b-54e2-4e22-91e3-5708f15502c6 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:12.983499 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ea80db7b-54e2-4e22-91e3-5708f15502c6 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:12.984215 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ea80db7b-54e2-4e22-91e3-5708f15502c6 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:13.034941 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-de9aff85-a852-4e3e-8c16-81514c125e1e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:13.040298 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-de9aff85-a852-4e3e-8c16-81514c125e1e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:13.057779 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-de9aff85-a852-4e3e-8c16-81514c125e1e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:13.058293 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-de9aff85-a852-4e3e-8c16-81514c125e1e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:13.058758 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-de9aff85-a852-4e3e-8c16-81514c125e1e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:13.059665 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-de9aff85-a852-4e3e-8c16-81514c125e1e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:13.060337 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-de9aff85-a852-4e3e-8c16-81514c125e1e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:13.060774 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-de9aff85-a852-4e3e-8c16-81514c125e1e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:13.094192 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-ea80db7b-54e2-4e22-91e3-5708f15502c6 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:13.119027 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-ea80db7b-54e2-4e22-91e3-5708f15502c6 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1138 microversion: 2.1 time: 0.169954 Aug 31 13:01:13.119646 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 128/273] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:12 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1138 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:13.394078 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-de9aff85-a852-4e3e-8c16-81514c125e1e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:13.402353 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-de9aff85-a852-4e3e-8c16-81514c125e1e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.371320 Aug 31 13:01:13.403459 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 146/274] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:13 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:01:13.418861 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-6b5e3dc2-8e69-4012-8363-85c5d2aba328 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:13.419564 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-6b5e3dc2-8e69-4012-8363-85c5d2aba328 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ba62b7ce-5880-4281-a5a4-020d70e5b16d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:13.426554 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6b5e3dc2-8e69-4012-8363-85c5d2aba328 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:13.427516 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6b5e3dc2-8e69-4012-8363-85c5d2aba328 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:13.428173 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6b5e3dc2-8e69-4012-8363-85c5d2aba328 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:13.428858 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6b5e3dc2-8e69-4012-8363-85c5d2aba328 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:13.429299 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6b5e3dc2-8e69-4012-8363-85c5d2aba328 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:13.430135 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6b5e3dc2-8e69-4012-8363-85c5d2aba328 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:13.436845 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=100 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:13.593531 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-6b5e3dc2-8e69-4012-8363-85c5d2aba328 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:13.604443 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-6b5e3dc2-8e69-4012-8363-85c5d2aba328 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d" status: 200 len: 1366 microversion: 2.1 time: 0.202238 Aug 31 13:01:13.605044 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 129/275] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:13 2022] GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:01:14.141441 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-40d2c5ce-afbc-4db8-8537-e030ddeb85a2 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:14.143022 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-40d2c5ce-afbc-4db8-8537-e030ddeb85a2 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:14.150670 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-40d2c5ce-afbc-4db8-8537-e030ddeb85a2 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:14.151151 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-40d2c5ce-afbc-4db8-8537-e030ddeb85a2 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:14.151701 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-40d2c5ce-afbc-4db8-8537-e030ddeb85a2 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:14.152409 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-40d2c5ce-afbc-4db8-8537-e030ddeb85a2 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:14.153080 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-40d2c5ce-afbc-4db8-8537-e030ddeb85a2 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:14.153505 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-40d2c5ce-afbc-4db8-8537-e030ddeb85a2 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:14.224976 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-40d2c5ce-afbc-4db8-8537-e030ddeb85a2 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:14.233612 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-40d2c5ce-afbc-4db8-8537-e030ddeb85a2 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1130 microversion: 2.1 time: 0.096571 Aug 31 13:01:14.234182 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 147/276] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:14 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1130 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:14.425374 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-25f36870-9779-4fcd-8a55-96c0451af731 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:14.426772 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-25f36870-9779-4fcd-8a55-96c0451af731 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:14.433718 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-25f36870-9779-4fcd-8a55-96c0451af731 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:14.434154 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-25f36870-9779-4fcd-8a55-96c0451af731 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:14.434954 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-25f36870-9779-4fcd-8a55-96c0451af731 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:14.435715 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-25f36870-9779-4fcd-8a55-96c0451af731 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:14.436223 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-25f36870-9779-4fcd-8a55-96c0451af731 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:14.436729 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-25f36870-9779-4fcd-8a55-96c0451af731 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:14.582451 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-25f36870-9779-4fcd-8a55-96c0451af731 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:14.591256 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-25f36870-9779-4fcd-8a55-96c0451af731 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.170997 Aug 31 13:01:14.592620 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 130/277] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:14 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:14.626547 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-cb0479d5-21f5-46b3-98c9-d8a974974953 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:14.627325 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-cb0479d5-21f5-46b3-98c9-d8a974974953 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ba62b7ce-5880-4281-a5a4-020d70e5b16d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:14.633804 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cb0479d5-21f5-46b3-98c9-d8a974974953 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:14.634514 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cb0479d5-21f5-46b3-98c9-d8a974974953 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:14.635118 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cb0479d5-21f5-46b3-98c9-d8a974974953 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:14.636123 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cb0479d5-21f5-46b3-98c9-d8a974974953 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:14.636573 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cb0479d5-21f5-46b3-98c9-d8a974974953 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:14.636992 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cb0479d5-21f5-46b3-98c9-d8a974974953 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:14.773846 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-cb0479d5-21f5-46b3-98c9-d8a974974953 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:14.781711 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-cb0479d5-21f5-46b3-98c9-d8a974974953 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d" status: 200 len: 1366 microversion: 2.1 time: 0.159108 Aug 31 13:01:14.782293 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 148/278] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:14 2022] GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:15.259402 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3ecfb88e-87c8-42b8-92ec-7dda47b92ff0 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:15.260300 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-3ecfb88e-87c8-42b8-92ec-7dda47b92ff0 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:15.270635 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3ecfb88e-87c8-42b8-92ec-7dda47b92ff0 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:15.271469 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3ecfb88e-87c8-42b8-92ec-7dda47b92ff0 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:15.272344 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3ecfb88e-87c8-42b8-92ec-7dda47b92ff0 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:15.273565 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3ecfb88e-87c8-42b8-92ec-7dda47b92ff0 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:15.274280 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3ecfb88e-87c8-42b8-92ec-7dda47b92ff0 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:15.274978 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3ecfb88e-87c8-42b8-92ec-7dda47b92ff0 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:15.344190 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-3ecfb88e-87c8-42b8-92ec-7dda47b92ff0 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:15.356399 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-3ecfb88e-87c8-42b8-92ec-7dda47b92ff0 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1130 microversion: 2.1 time: 0.103846 Aug 31 13:01:15.357224 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 131/279] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:15 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1130 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:15.613880 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-dc019926-86d6-425d-b4a2-e02556dc1ab7 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:15.614697 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-dc019926-86d6-425d-b4a2-e02556dc1ab7 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:15.621263 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-dc019926-86d6-425d-b4a2-e02556dc1ab7 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:15.621732 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-dc019926-86d6-425d-b4a2-e02556dc1ab7 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:15.622156 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-dc019926-86d6-425d-b4a2-e02556dc1ab7 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:15.622840 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-dc019926-86d6-425d-b4a2-e02556dc1ab7 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:15.623436 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-dc019926-86d6-425d-b4a2-e02556dc1ab7 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:15.624015 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-dc019926-86d6-425d-b4a2-e02556dc1ab7 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:15.762905 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-dc019926-86d6-425d-b4a2-e02556dc1ab7 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:15.771442 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-dc019926-86d6-425d-b4a2-e02556dc1ab7 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.161629 Aug 31 13:01:15.772060 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 149/280] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:15 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:15.803242 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-67428a1f-90f6-4a2c-bd34-2caf59a6757d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:15.803850 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-67428a1f-90f6-4a2c-bd34-2caf59a6757d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ba62b7ce-5880-4281-a5a4-020d70e5b16d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:15.810458 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-67428a1f-90f6-4a2c-bd34-2caf59a6757d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:15.810954 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-67428a1f-90f6-4a2c-bd34-2caf59a6757d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:15.811374 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-67428a1f-90f6-4a2c-bd34-2caf59a6757d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:15.812096 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-67428a1f-90f6-4a2c-bd34-2caf59a6757d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:15.812534 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-67428a1f-90f6-4a2c-bd34-2caf59a6757d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:15.812942 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-67428a1f-90f6-4a2c-bd34-2caf59a6757d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:15.946480 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-67428a1f-90f6-4a2c-bd34-2caf59a6757d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:15.954742 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-67428a1f-90f6-4a2c-bd34-2caf59a6757d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d" status: 200 len: 1366 microversion: 2.1 time: 0.155315 Aug 31 13:01:15.955348 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 132/281] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:15 2022] GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:16.382059 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-a584ef8e-23ba-401a-9656-e432d0329436 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:16.383051 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-a584ef8e-23ba-401a-9656-e432d0329436 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:16.391573 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a584ef8e-23ba-401a-9656-e432d0329436 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:16.392165 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a584ef8e-23ba-401a-9656-e432d0329436 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:16.392510 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a584ef8e-23ba-401a-9656-e432d0329436 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:16.393223 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a584ef8e-23ba-401a-9656-e432d0329436 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:16.393691 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a584ef8e-23ba-401a-9656-e432d0329436 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:16.394106 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a584ef8e-23ba-401a-9656-e432d0329436 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:16.461928 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-a584ef8e-23ba-401a-9656-e432d0329436 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:16.470318 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-a584ef8e-23ba-401a-9656-e432d0329436 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1130 microversion: 2.1 time: 0.095243 Aug 31 13:01:16.470905 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 150/282] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:16 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1130 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:16.793275 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-14052e0d-5dba-4c40-80f7-ffd73e513136 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:16.793884 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-14052e0d-5dba-4c40-80f7-ffd73e513136 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:16.800753 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-14052e0d-5dba-4c40-80f7-ffd73e513136 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:16.801301 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-14052e0d-5dba-4c40-80f7-ffd73e513136 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:16.801802 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-14052e0d-5dba-4c40-80f7-ffd73e513136 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:16.802567 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-14052e0d-5dba-4c40-80f7-ffd73e513136 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:16.803110 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-14052e0d-5dba-4c40-80f7-ffd73e513136 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:16.803598 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-14052e0d-5dba-4c40-80f7-ffd73e513136 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:16.941543 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-14052e0d-5dba-4c40-80f7-ffd73e513136 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:16.949798 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-14052e0d-5dba-4c40-80f7-ffd73e513136 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.160542 Aug 31 13:01:16.950419 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 133/283] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:16 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:16.977099 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-4bfa8a66-4740-4353-9ec4-5a7db0165866 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:16.977700 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-4bfa8a66-4740-4353-9ec4-5a7db0165866 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ba62b7ce-5880-4281-a5a4-020d70e5b16d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:16.984700 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4bfa8a66-4740-4353-9ec4-5a7db0165866 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:16.985187 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4bfa8a66-4740-4353-9ec4-5a7db0165866 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:16.985624 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4bfa8a66-4740-4353-9ec4-5a7db0165866 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:16.986331 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4bfa8a66-4740-4353-9ec4-5a7db0165866 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:16.986780 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4bfa8a66-4740-4353-9ec4-5a7db0165866 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:16.987199 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4bfa8a66-4740-4353-9ec4-5a7db0165866 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:17.119053 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-4bfa8a66-4740-4353-9ec4-5a7db0165866 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:17.127864 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-4bfa8a66-4740-4353-9ec4-5a7db0165866 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d" status: 200 len: 1366 microversion: 2.1 time: 0.154693 Aug 31 13:01:17.128485 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 151/284] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:16 2022] GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:17.497100 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e366905f-4124-4eea-927c-5ce0408652cf tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:17.498071 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e366905f-4124-4eea-927c-5ce0408652cf tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:17.505509 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e366905f-4124-4eea-927c-5ce0408652cf tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:17.505984 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e366905f-4124-4eea-927c-5ce0408652cf tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:17.506413 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e366905f-4124-4eea-927c-5ce0408652cf tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:17.507096 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e366905f-4124-4eea-927c-5ce0408652cf tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:17.507096 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e366905f-4124-4eea-927c-5ce0408652cf tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:17.507958 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e366905f-4124-4eea-927c-5ce0408652cf tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:17.580379 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e366905f-4124-4eea-927c-5ce0408652cf tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:17.591526 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e366905f-4124-4eea-927c-5ce0408652cf tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1130 microversion: 2.1 time: 0.102515 Aug 31 13:01:17.592443 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 134/285] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:17 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1130 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:17.973745 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-048a4535-3d63-4aa1-b737-2cf25db633ba tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:17.974635 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-048a4535-3d63-4aa1-b737-2cf25db633ba tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:17.984204 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-048a4535-3d63-4aa1-b737-2cf25db633ba tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:17.984794 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-048a4535-3d63-4aa1-b737-2cf25db633ba tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:17.985106 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-048a4535-3d63-4aa1-b737-2cf25db633ba tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:17.985799 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-048a4535-3d63-4aa1-b737-2cf25db633ba tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:17.986245 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-048a4535-3d63-4aa1-b737-2cf25db633ba tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:17.986665 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-048a4535-3d63-4aa1-b737-2cf25db633ba tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:18.121869 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-048a4535-3d63-4aa1-b737-2cf25db633ba tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:18.134303 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-048a4535-3d63-4aa1-b737-2cf25db633ba tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1522 microversion: 2.1 time: 0.166540 Aug 31 13:01:18.134908 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 152/286] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:17 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:18.148637 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e742cf12-2cfa-4117-9917-3d7720e41437 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:18.149254 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e742cf12-2cfa-4117-9917-3d7720e41437 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ba62b7ce-5880-4281-a5a4-020d70e5b16d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:18.155961 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e742cf12-2cfa-4117-9917-3d7720e41437 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:18.156442 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e742cf12-2cfa-4117-9917-3d7720e41437 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:18.156867 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e742cf12-2cfa-4117-9917-3d7720e41437 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:18.157893 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e742cf12-2cfa-4117-9917-3d7720e41437 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:18.158032 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e742cf12-2cfa-4117-9917-3d7720e41437 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:18.158479 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e742cf12-2cfa-4117-9917-3d7720e41437 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:18.339641 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e742cf12-2cfa-4117-9917-3d7720e41437 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:18.349191 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e742cf12-2cfa-4117-9917-3d7720e41437 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d" status: 200 len: 1366 microversion: 2.1 time: 0.204473 Aug 31 13:01:18.349851 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 135/287] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:18 2022] GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:18.613988 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-c5bb071b-a3aa-4e8a-ba95-509d5dc6f2a2 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:18.614620 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-c5bb071b-a3aa-4e8a-ba95-509d5dc6f2a2 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:18.621296 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c5bb071b-a3aa-4e8a-ba95-509d5dc6f2a2 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:18.621700 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c5bb071b-a3aa-4e8a-ba95-509d5dc6f2a2 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:18.622133 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c5bb071b-a3aa-4e8a-ba95-509d5dc6f2a2 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:18.622832 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c5bb071b-a3aa-4e8a-ba95-509d5dc6f2a2 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:18.623318 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c5bb071b-a3aa-4e8a-ba95-509d5dc6f2a2 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:18.623743 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c5bb071b-a3aa-4e8a-ba95-509d5dc6f2a2 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:18.691842 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-c5bb071b-a3aa-4e8a-ba95-509d5dc6f2a2 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:18.700032 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-c5bb071b-a3aa-4e8a-ba95-509d5dc6f2a2 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1186 microversion: 2.1 time: 0.090053 Aug 31 13:01:18.700619 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 153/288] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:18 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1186 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:19.158103 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-66e3dd3a-cd36-4788-865d-4e7084368f00 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:19.159053 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-66e3dd3a-cd36-4788-865d-4e7084368f00 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:19.167465 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-66e3dd3a-cd36-4788-865d-4e7084368f00 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:19.168159 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-66e3dd3a-cd36-4788-865d-4e7084368f00 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:19.168713 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-66e3dd3a-cd36-4788-865d-4e7084368f00 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:19.169652 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-66e3dd3a-cd36-4788-865d-4e7084368f00 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:19.170213 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-66e3dd3a-cd36-4788-865d-4e7084368f00 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:19.170753 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-66e3dd3a-cd36-4788-865d-4e7084368f00 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:19.306083 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-66e3dd3a-cd36-4788-865d-4e7084368f00 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:19.314201 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-66e3dd3a-cd36-4788-865d-4e7084368f00 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1502 microversion: 2.1 time: 0.161604 Aug 31 13:01:19.314768 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 136/289] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:19 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1502 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:19.334514 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-133daf4c-4f3c-45e9-a007-cf5effa4c8fa tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:19.335133 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-133daf4c-4f3c-45e9-a007-cf5effa4c8fa tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: f97b98c1-e7be-4c90-8c65-715135db482b] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:19.341822 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-133daf4c-4f3c-45e9-a007-cf5effa4c8fa tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:19.342305 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-133daf4c-4f3c-45e9-a007-cf5effa4c8fa tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:19.342735 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-133daf4c-4f3c-45e9-a007-cf5effa4c8fa tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:19.343428 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-133daf4c-4f3c-45e9-a007-cf5effa4c8fa tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:19.343935 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-133daf4c-4f3c-45e9-a007-cf5effa4c8fa tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:19.344358 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-133daf4c-4f3c-45e9-a007-cf5effa4c8fa tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:19.348376 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell1:SELECT=100 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:19.370248 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3dbc1be0-d8d6-489a-9ab7-14c74d0e78d7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:19.370863 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-3dbc1be0-d8d6-489a-9ab7-14c74d0e78d7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ba62b7ce-5880-4281-a5a4-020d70e5b16d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:19.377225 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3dbc1be0-d8d6-489a-9ab7-14c74d0e78d7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:19.377709 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3dbc1be0-d8d6-489a-9ab7-14c74d0e78d7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:19.378141 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3dbc1be0-d8d6-489a-9ab7-14c74d0e78d7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:19.378832 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3dbc1be0-d8d6-489a-9ab7-14c74d0e78d7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:19.379276 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3dbc1be0-d8d6-489a-9ab7-14c74d0e78d7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:19.379694 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3dbc1be0-d8d6-489a-9ab7-14c74d0e78d7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:19.539078 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-133daf4c-4f3c-45e9-a007-cf5effa4c8fa tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:19.547370 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-133daf4c-4f3c-45e9-a007-cf5effa4c8fa tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b" status: 200 len: 1515 microversion: 2.1 time: 0.216766 Aug 31 13:01:19.548117 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 154/290] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:19 2022] GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b => generated 1515 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:19.560546 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-3dbc1be0-d8d6-489a-9ab7-14c74d0e78d7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:19.569574 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-3dbc1be0-d8d6-489a-9ab7-14c74d0e78d7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d" status: 200 len: 1366 microversion: 2.1 time: 0.203169 Aug 31 13:01:19.570151 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 137/291] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:19 2022] GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:01:19.737174 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-226bfbb2-fd49-4e21-8d6f-f192a15cdeec tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:19.737798 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-226bfbb2-fd49-4e21-8d6f-f192a15cdeec tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:19.747205 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-226bfbb2-fd49-4e21-8d6f-f192a15cdeec tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:19.747787 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-226bfbb2-fd49-4e21-8d6f-f192a15cdeec tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:19.748308 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-226bfbb2-fd49-4e21-8d6f-f192a15cdeec tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:19.749010 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-226bfbb2-fd49-4e21-8d6f-f192a15cdeec tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:19.749459 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-226bfbb2-fd49-4e21-8d6f-f192a15cdeec tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:19.749875 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-226bfbb2-fd49-4e21-8d6f-f192a15cdeec tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:19.876279 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-226bfbb2-fd49-4e21-8d6f-f192a15cdeec tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:19.884720 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-226bfbb2-fd49-4e21-8d6f-f192a15cdeec tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1186 microversion: 2.1 time: 0.160584 Aug 31 13:01:19.885614 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 155/292] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:19 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1186 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:01:20.595514 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-8743e119-d25e-4093-86bf-6b81cb62a6da tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:20.596349 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-8743e119-d25e-4093-86bf-6b81cb62a6da tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ba62b7ce-5880-4281-a5a4-020d70e5b16d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:20.606241 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8743e119-d25e-4093-86bf-6b81cb62a6da tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:20.606854 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8743e119-d25e-4093-86bf-6b81cb62a6da tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:20.607351 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8743e119-d25e-4093-86bf-6b81cb62a6da tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:20.608261 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8743e119-d25e-4093-86bf-6b81cb62a6da tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:20.608714 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8743e119-d25e-4093-86bf-6b81cb62a6da tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:20.609209 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8743e119-d25e-4093-86bf-6b81cb62a6da tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:20.749936 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-8743e119-d25e-4093-86bf-6b81cb62a6da tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:20.757942 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-8743e119-d25e-4093-86bf-6b81cb62a6da tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d" status: 200 len: 1556 microversion: 2.1 time: 0.171010 Aug 31 13:01:20.758525 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 138/293] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:20 2022] GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d => generated 1556 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:20.781532 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-40f4245e-536b-423e-a7e7-f6b7c01ec0b9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:20.782058 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-40f4245e-536b-423e-a7e7-f6b7c01ec0b9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ba62b7ce-5880-4281-a5a4-020d70e5b16d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:20.789940 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-40f4245e-536b-423e-a7e7-f6b7c01ec0b9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:20.790441 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-40f4245e-536b-423e-a7e7-f6b7c01ec0b9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:20.790861 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-40f4245e-536b-423e-a7e7-f6b7c01ec0b9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:20.791660 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-40f4245e-536b-423e-a7e7-f6b7c01ec0b9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:20.792323 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-40f4245e-536b-423e-a7e7-f6b7c01ec0b9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:20.792970 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-40f4245e-536b-423e-a7e7-f6b7c01ec0b9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:20.878103 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-40f4245e-536b-423e-a7e7-f6b7c01ec0b9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100775 Aug 31 13:01:20.878791 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 156/294] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 31 13:01:20 2022] GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:01:20.906461 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-4856d0ee-59f3-4dee-aa98-4a501ec0b8a3 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:20.907037 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-4856d0ee-59f3-4dee-aa98-4a501ec0b8a3 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:20.914389 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4856d0ee-59f3-4dee-aa98-4a501ec0b8a3 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:20.914867 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4856d0ee-59f3-4dee-aa98-4a501ec0b8a3 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:20.915302 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4856d0ee-59f3-4dee-aa98-4a501ec0b8a3 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:20.916046 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4856d0ee-59f3-4dee-aa98-4a501ec0b8a3 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:20.916444 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4856d0ee-59f3-4dee-aa98-4a501ec0b8a3 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:20.917002 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4856d0ee-59f3-4dee-aa98-4a501ec0b8a3 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:20.991443 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-9959c6e0-c6c1-4ac1-9b2a-bc91a7673cf8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:01:20.995520 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-9959c6e0-c6c1-4ac1-9b2a-bc91a7673cf8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: f97b98c1-e7be-4c90-8c65-715135db482b] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:21.003937 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9959c6e0-c6c1-4ac1-9b2a-bc91a7673cf8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:21.005380 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9959c6e0-c6c1-4ac1-9b2a-bc91a7673cf8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:21.005971 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9959c6e0-c6c1-4ac1-9b2a-bc91a7673cf8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:21.007952 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9959c6e0-c6c1-4ac1-9b2a-bc91a7673cf8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:21.008568 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9959c6e0-c6c1-4ac1-9b2a-bc91a7673cf8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:21.009218 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9959c6e0-c6c1-4ac1-9b2a-bc91a7673cf8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:21.026968 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-4856d0ee-59f3-4dee-aa98-4a501ec0b8a3 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:21.039207 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-4856d0ee-59f3-4dee-aa98-4a501ec0b8a3 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1194 microversion: 2.1 time: 0.136754 Aug 31 13:01:21.041448 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 139/295] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:20 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1194 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:21.055433 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.objects.instance [None req-9959c6e0-c6c1-4ac1-9b2a-bc91a7673cf8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lazy-loading 'flavor' on Instance uuid f97b98c1-e7be-4c90-8c65-715135db482b {{(pid=120704) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 13:01:21.135679 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-9959c6e0-c6c1-4ac1-9b2a-bc91a7673cf8 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "POST /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b/action" status: 200 len: 32 microversion: 2.1 time: 0.150466 Aug 31 13:01:21.136409 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 157/296] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 31 13:01:20 2022] POST /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b/action => generated 32 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 13:01:21.146039 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-cec5c2c5-4339-4e4b-894d-a8e82968446e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:21.146649 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-cec5c2c5-4339-4e4b-894d-a8e82968446e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: f97b98c1-e7be-4c90-8c65-715135db482b] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:21.152892 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cec5c2c5-4339-4e4b-894d-a8e82968446e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:21.153420 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cec5c2c5-4339-4e4b-894d-a8e82968446e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:21.153904 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cec5c2c5-4339-4e4b-894d-a8e82968446e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:21.154758 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cec5c2c5-4339-4e4b-894d-a8e82968446e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:21.155165 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cec5c2c5-4339-4e4b-894d-a8e82968446e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:21.155584 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cec5c2c5-4339-4e4b-894d-a8e82968446e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:21.285713 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-cec5c2c5-4339-4e4b-894d-a8e82968446e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:21.294027 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-cec5c2c5-4339-4e4b-894d-a8e82968446e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b" status: 200 len: 1521 microversion: 2.1 time: 0.151908 Aug 31 13:01:21.294546 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 140/297] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:21 2022] GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:21.862348 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-c8371c52-a12b-4ea5-bb2c-a22363348150 req-1a3e5a6e-b156-4d8a-9d55-d0a43bef5a53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba62b7ce-5880-4281-a5a4-020d70e5b16d", "tag": "aa4db9c7-a72c-4448-8fdd-44507dfa381d"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:01:21.872058 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-c8371c52-a12b-4ea5-bb2c-a22363348150 req-1a3e5a6e-b156-4d8a-9d55-d0a43bef5a53 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:21.872595 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-c8371c52-a12b-4ea5-bb2c-a22363348150 req-1a3e5a6e-b156-4d8a-9d55-d0a43bef5a53 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:21.873130 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-c8371c52-a12b-4ea5-bb2c-a22363348150 req-1a3e5a6e-b156-4d8a-9d55-d0a43bef5a53 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:21.884543 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-c8371c52-a12b-4ea5-bb2c-a22363348150 req-1a3e5a6e-b156-4d8a-9d55-d0a43bef5a53 service nova] Creating event network-changed:aa4db9c7-a72c-4448-8fdd-44507dfa381d for instance ba62b7ce-5880-4281-a5a4-020d70e5b16d on hv-cinder-85442 Aug 31 13:01:21.889643 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-c8371c52-a12b-4ea5-bb2c-a22363348150 req-1a3e5a6e-b156-4d8a-9d55-d0a43bef5a53 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032132 Aug 31 13:01:21.890350 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 158/298] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:01:22.062458 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-4b06da90-d2d3-4461-b644-633a68800308 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:22.063046 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-4b06da90-d2d3-4461-b644-633a68800308 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:22.065015 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=2 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:22.065709 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=8 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:22.072461 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4b06da90-d2d3-4461-b644-633a68800308 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:22.072942 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4b06da90-d2d3-4461-b644-633a68800308 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:22.073373 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4b06da90-d2d3-4461-b644-633a68800308 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:22.074051 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4b06da90-d2d3-4461-b644-633a68800308 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:22.074492 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4b06da90-d2d3-4461-b644-633a68800308 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:22.074905 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4b06da90-d2d3-4461-b644-633a68800308 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:22.138172 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-4b06da90-d2d3-4461-b644-633a68800308 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:22.146496 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-4b06da90-d2d3-4461-b644-633a68800308 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1204 microversion: 2.1 time: 0.088027 Aug 31 13:01:22.147084 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 141/299] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:22 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1204 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:22.315313 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-77a314fe-772b-4daa-bca8-14d3c02df998 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:22.316047 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-77a314fe-772b-4daa-bca8-14d3c02df998 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: f97b98c1-e7be-4c90-8c65-715135db482b] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:22.322473 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-77a314fe-772b-4daa-bca8-14d3c02df998 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:22.322975 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-77a314fe-772b-4daa-bca8-14d3c02df998 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:22.323380 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-77a314fe-772b-4daa-bca8-14d3c02df998 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:22.324089 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-77a314fe-772b-4daa-bca8-14d3c02df998 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:22.324528 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-77a314fe-772b-4daa-bca8-14d3c02df998 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:22.324936 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-77a314fe-772b-4daa-bca8-14d3c02df998 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:22.686910 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-77a314fe-772b-4daa-bca8-14d3c02df998 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:22.695262 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-77a314fe-772b-4daa-bca8-14d3c02df998 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b" status: 200 len: 1521 microversion: 2.1 time: 0.384154 Aug 31 13:01:22.696063 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 159/300] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:22 2022] GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b => generated 1521 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:23.170221 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-f5a90c9c-410c-4db8-966e-ac754f1c9385 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:23.170795 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-f5a90c9c-410c-4db8-966e-ac754f1c9385 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:23.178565 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f5a90c9c-410c-4db8-966e-ac754f1c9385 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:23.179018 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f5a90c9c-410c-4db8-966e-ac754f1c9385 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:23.179333 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f5a90c9c-410c-4db8-966e-ac754f1c9385 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:23.180295 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f5a90c9c-410c-4db8-966e-ac754f1c9385 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:23.180728 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f5a90c9c-410c-4db8-966e-ac754f1c9385 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:23.181148 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f5a90c9c-410c-4db8-966e-ac754f1c9385 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:23.252341 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-f5a90c9c-410c-4db8-966e-ac754f1c9385 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:23.265134 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-f5a90c9c-410c-4db8-966e-ac754f1c9385 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1204 microversion: 2.1 time: 0.100048 Aug 31 13:01:23.265736 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 142/301] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:23 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1204 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:23.720125 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-8dc88a83-d728-47f0-9369-0852d580c18f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:23.720863 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-8dc88a83-d728-47f0-9369-0852d580c18f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: f97b98c1-e7be-4c90-8c65-715135db482b] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:23.729427 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8dc88a83-d728-47f0-9369-0852d580c18f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:23.730029 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8dc88a83-d728-47f0-9369-0852d580c18f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:23.730567 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8dc88a83-d728-47f0-9369-0852d580c18f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:23.731421 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8dc88a83-d728-47f0-9369-0852d580c18f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:23.732024 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8dc88a83-d728-47f0-9369-0852d580c18f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:23.732556 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8dc88a83-d728-47f0-9369-0852d580c18f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:23.871538 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-8dc88a83-d728-47f0-9369-0852d580c18f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:23.883127 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-8dc88a83-d728-47f0-9369-0852d580c18f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b" status: 200 len: 1521 microversion: 2.1 time: 0.168522 Aug 31 13:01:23.883961 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 160/302] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:23 2022] GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:24.293703 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-6e088898-59b5-4904-aefe-7b3155761a53 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:24.294714 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-6e088898-59b5-4904-aefe-7b3155761a53 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:24.305383 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6e088898-59b5-4904-aefe-7b3155761a53 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:24.306185 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6e088898-59b5-4904-aefe-7b3155761a53 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:24.306907 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6e088898-59b5-4904-aefe-7b3155761a53 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:24.308083 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6e088898-59b5-4904-aefe-7b3155761a53 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:24.308820 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6e088898-59b5-4904-aefe-7b3155761a53 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:24.309545 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6e088898-59b5-4904-aefe-7b3155761a53 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:24.374421 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-6e088898-59b5-4904-aefe-7b3155761a53 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:24.382624 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-6e088898-59b5-4904-aefe-7b3155761a53 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1204 microversion: 2.1 time: 0.096039 Aug 31 13:01:24.383199 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 143/303] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:24 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1204 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:24.905003 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-a82748e3-3d16-404e-8455-7e94850af19e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:24.905903 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-a82748e3-3d16-404e-8455-7e94850af19e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: f97b98c1-e7be-4c90-8c65-715135db482b] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:24.912462 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a82748e3-3d16-404e-8455-7e94850af19e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:24.912930 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a82748e3-3d16-404e-8455-7e94850af19e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:24.913665 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a82748e3-3d16-404e-8455-7e94850af19e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:24.914338 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a82748e3-3d16-404e-8455-7e94850af19e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:24.914773 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a82748e3-3d16-404e-8455-7e94850af19e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:24.915184 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a82748e3-3d16-404e-8455-7e94850af19e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:25.053952 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-a82748e3-3d16-404e-8455-7e94850af19e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:25.062348 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-a82748e3-3d16-404e-8455-7e94850af19e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b" status: 200 len: 1521 microversion: 2.1 time: 0.161317 Aug 31 13:01:25.062915 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 161/304] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:24 2022] GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:01:25.407296 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3ebe1e39-df5e-45b7-86bd-acf5a80447af tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:25.408014 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-3ebe1e39-df5e-45b7-86bd-acf5a80447af tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:25.416195 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3ebe1e39-df5e-45b7-86bd-acf5a80447af tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:25.417574 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3ebe1e39-df5e-45b7-86bd-acf5a80447af tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:25.418768 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3ebe1e39-df5e-45b7-86bd-acf5a80447af tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:25.419479 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3ebe1e39-df5e-45b7-86bd-acf5a80447af tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:25.420612 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3ebe1e39-df5e-45b7-86bd-acf5a80447af tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:25.421638 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3ebe1e39-df5e-45b7-86bd-acf5a80447af tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:25.493140 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-3ebe1e39-df5e-45b7-86bd-acf5a80447af tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:25.501430 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-3ebe1e39-df5e-45b7-86bd-acf5a80447af tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1204 microversion: 2.1 time: 0.101773 Aug 31 13:01:25.502051 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 144/305] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:25 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1204 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:26.084545 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-1b989cd9-b0a4-4753-8ab2-062d219e7250 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:26.085104 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-1b989cd9-b0a4-4753-8ab2-062d219e7250 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: f97b98c1-e7be-4c90-8c65-715135db482b] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:26.092533 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1b989cd9-b0a4-4753-8ab2-062d219e7250 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:26.093030 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1b989cd9-b0a4-4753-8ab2-062d219e7250 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:26.093461 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1b989cd9-b0a4-4753-8ab2-062d219e7250 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:26.094156 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1b989cd9-b0a4-4753-8ab2-062d219e7250 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:26.094600 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1b989cd9-b0a4-4753-8ab2-062d219e7250 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:26.095016 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1b989cd9-b0a4-4753-8ab2-062d219e7250 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:26.365692 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-1b989cd9-b0a4-4753-8ab2-062d219e7250 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:26.379913 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-1b989cd9-b0a4-4753-8ab2-062d219e7250 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b" status: 200 len: 1521 microversion: 2.1 time: 0.299387 Aug 31 13:01:26.380759 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 162/306] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:26 2022] GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:26.525044 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-8ab84073-a484-494e-b18d-ea4c28551874 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:26.525737 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-8ab84073-a484-494e-b18d-ea4c28551874 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:26.532732 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8ab84073-a484-494e-b18d-ea4c28551874 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:26.533214 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8ab84073-a484-494e-b18d-ea4c28551874 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:26.533641 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8ab84073-a484-494e-b18d-ea4c28551874 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:26.534504 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8ab84073-a484-494e-b18d-ea4c28551874 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:26.534949 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8ab84073-a484-494e-b18d-ea4c28551874 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:26.535365 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8ab84073-a484-494e-b18d-ea4c28551874 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:26.626709 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-8ab84073-a484-494e-b18d-ea4c28551874 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:26.630493 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=100 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:26.638342 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-8ab84073-a484-494e-b18d-ea4c28551874 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1204 microversion: 2.1 time: 0.117110 Aug 31 13:01:26.639196 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 145/307] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:26 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1204 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:27.403135 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-34ea3506-6777-492f-a1ad-59104f7c6c70 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:27.403802 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-34ea3506-6777-492f-a1ad-59104f7c6c70 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: f97b98c1-e7be-4c90-8c65-715135db482b] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:27.412156 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-34ea3506-6777-492f-a1ad-59104f7c6c70 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:27.412769 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-34ea3506-6777-492f-a1ad-59104f7c6c70 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:27.413501 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-34ea3506-6777-492f-a1ad-59104f7c6c70 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:27.414584 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-34ea3506-6777-492f-a1ad-59104f7c6c70 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:27.415047 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-34ea3506-6777-492f-a1ad-59104f7c6c70 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:27.415449 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-34ea3506-6777-492f-a1ad-59104f7c6c70 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:27.673253 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3ac75379-c84f-4efa-896a-27c586c06f48 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:27.674344 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-3ac75379-c84f-4efa-896a-27c586c06f48 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:27.681383 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-34ea3506-6777-492f-a1ad-59104f7c6c70 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:27.681586 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3ac75379-c84f-4efa-896a-27c586c06f48 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:27.682030 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3ac75379-c84f-4efa-896a-27c586c06f48 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:27.682455 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3ac75379-c84f-4efa-896a-27c586c06f48 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:27.683140 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3ac75379-c84f-4efa-896a-27c586c06f48 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:27.683776 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3ac75379-c84f-4efa-896a-27c586c06f48 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:27.684738 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3ac75379-c84f-4efa-896a-27c586c06f48 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:27.692329 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-34ea3506-6777-492f-a1ad-59104f7c6c70 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b" status: 200 len: 1521 microversion: 2.1 time: 0.294995 Aug 31 13:01:27.694407 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 163/308] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:27 2022] GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:27.911479 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-3ac75379-c84f-4efa-896a-27c586c06f48 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:27.929751 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-3ac75379-c84f-4efa-896a-27c586c06f48 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1272 microversion: 2.1 time: 0.273226 Aug 31 13:01:27.949418 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-5b187d73-4a0b-4381-99be-570f959ae3e5 req-afc03fdb-11b1-4038-9b19-22cba8aeffac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e792077-8a21-48f8-8f65-ce1a4aae8c0a", "tag": "22506bf3-0225-4ad3-b8d6-55645f334201"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:01:27.959032 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 146/309] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:27 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1272 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:27.966314 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-5b187d73-4a0b-4381-99be-570f959ae3e5 req-afc03fdb-11b1-4038-9b19-22cba8aeffac service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:27.966788 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-5b187d73-4a0b-4381-99be-570f959ae3e5 req-afc03fdb-11b1-4038-9b19-22cba8aeffac service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:27.967397 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-5b187d73-4a0b-4381-99be-570f959ae3e5 req-afc03fdb-11b1-4038-9b19-22cba8aeffac service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:27.981067 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-5b187d73-4a0b-4381-99be-570f959ae3e5 req-afc03fdb-11b1-4038-9b19-22cba8aeffac service nova] Creating event network-changed:22506bf3-0225-4ad3-b8d6-55645f334201 for instance 9e792077-8a21-48f8-8f65-ce1a4aae8c0a on hv-cinder-85442 Aug 31 13:01:27.986579 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-5b187d73-4a0b-4381-99be-570f959ae3e5 req-afc03fdb-11b1-4038-9b19-22cba8aeffac service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044966 Aug 31 13:01:27.987491 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 164/310] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:01:28.724771 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b6531637-b9a7-4d3f-a84f-86cd2565af49 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:28.725684 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b6531637-b9a7-4d3f-a84f-86cd2565af49 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: f97b98c1-e7be-4c90-8c65-715135db482b] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:28.735212 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b6531637-b9a7-4d3f-a84f-86cd2565af49 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:28.735985 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b6531637-b9a7-4d3f-a84f-86cd2565af49 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:28.736646 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b6531637-b9a7-4d3f-a84f-86cd2565af49 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:28.737634 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b6531637-b9a7-4d3f-a84f-86cd2565af49 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:28.738352 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b6531637-b9a7-4d3f-a84f-86cd2565af49 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:28.738992 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b6531637-b9a7-4d3f-a84f-86cd2565af49 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:28.944942 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-b6531637-b9a7-4d3f-a84f-86cd2565af49 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:28.955163 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b6531637-b9a7-4d3f-a84f-86cd2565af49 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b" status: 200 len: 1521 microversion: 2.1 time: 0.236412 Aug 31 13:01:28.955359 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-b983a841-4905-44aa-aae4-e2f0c7015f79 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:28.955803 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 147/311] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:28 2022] GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:28.956053 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-b983a841-4905-44aa-aae4-e2f0c7015f79 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:28.962195 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b983a841-4905-44aa-aae4-e2f0c7015f79 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:28.962668 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b983a841-4905-44aa-aae4-e2f0c7015f79 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:28.963095 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b983a841-4905-44aa-aae4-e2f0c7015f79 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:28.963781 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b983a841-4905-44aa-aae4-e2f0c7015f79 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:28.964253 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b983a841-4905-44aa-aae4-e2f0c7015f79 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:28.964669 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b983a841-4905-44aa-aae4-e2f0c7015f79 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:29.117081 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-b983a841-4905-44aa-aae4-e2f0c7015f79 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:29.126179 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-b983a841-4905-44aa-aae4-e2f0c7015f79 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1260 microversion: 2.1 time: 0.175514 Aug 31 13:01:29.126902 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 165/312] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:28 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:01:29.976515 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-a407267c-d76c-4cbc-8039-8a2d37f55354 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:29.977108 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-a407267c-d76c-4cbc-8039-8a2d37f55354 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: f97b98c1-e7be-4c90-8c65-715135db482b] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:29.983652 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a407267c-d76c-4cbc-8039-8a2d37f55354 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:29.984295 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a407267c-d76c-4cbc-8039-8a2d37f55354 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:29.984729 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a407267c-d76c-4cbc-8039-8a2d37f55354 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:29.985414 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a407267c-d76c-4cbc-8039-8a2d37f55354 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:29.985950 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a407267c-d76c-4cbc-8039-8a2d37f55354 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:29.986427 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a407267c-d76c-4cbc-8039-8a2d37f55354 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:30.144022 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-a407267c-d76c-4cbc-8039-8a2d37f55354 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:30.146869 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-7e200197-7595-4dcf-ab2d-878001aae23f tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:30.147488 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-7e200197-7595-4dcf-ab2d-878001aae23f tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:30.151979 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-a407267c-d76c-4cbc-8039-8a2d37f55354 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b" status: 200 len: 1521 microversion: 2.1 time: 0.179408 Aug 31 13:01:30.152585 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 148/313] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:29 2022] GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:30.154628 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7e200197-7595-4dcf-ab2d-878001aae23f tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:30.155123 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7e200197-7595-4dcf-ab2d-878001aae23f tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:30.155529 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7e200197-7595-4dcf-ab2d-878001aae23f tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:30.156285 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7e200197-7595-4dcf-ab2d-878001aae23f tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:30.156852 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7e200197-7595-4dcf-ab2d-878001aae23f tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:30.157241 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7e200197-7595-4dcf-ab2d-878001aae23f tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:30.294542 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-7e200197-7595-4dcf-ab2d-878001aae23f tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:30.302901 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-7e200197-7595-4dcf-ab2d-878001aae23f tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1260 microversion: 2.1 time: 0.160045 Aug 31 13:01:30.303478 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 166/314] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:30 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:31.176340 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-96a6f1f1-422c-4c7b-a033-40fb719cfe0f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:31.176841 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-96a6f1f1-422c-4c7b-a033-40fb719cfe0f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: f97b98c1-e7be-4c90-8c65-715135db482b] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:31.183491 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-96a6f1f1-422c-4c7b-a033-40fb719cfe0f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:31.184020 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-96a6f1f1-422c-4c7b-a033-40fb719cfe0f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:31.184454 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-96a6f1f1-422c-4c7b-a033-40fb719cfe0f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:31.185141 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-96a6f1f1-422c-4c7b-a033-40fb719cfe0f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:31.185591 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-96a6f1f1-422c-4c7b-a033-40fb719cfe0f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:31.186006 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-96a6f1f1-422c-4c7b-a033-40fb719cfe0f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:31.317548 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-96a6f1f1-422c-4c7b-a033-40fb719cfe0f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:31.324126 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-45387829-5c20-4222-8f22-bcd7977846d9 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:31.324756 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-45387829-5c20-4222-8f22-bcd7977846d9 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:31.326003 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-96a6f1f1-422c-4c7b-a033-40fb719cfe0f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b" status: 200 len: 1521 microversion: 2.1 time: 0.154993 Aug 31 13:01:31.326589 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 149/315] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:31 2022] GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:31.331684 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-45387829-5c20-4222-8f22-bcd7977846d9 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:31.332204 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-45387829-5c20-4222-8f22-bcd7977846d9 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:31.332638 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-45387829-5c20-4222-8f22-bcd7977846d9 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:31.333343 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-45387829-5c20-4222-8f22-bcd7977846d9 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:31.333798 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-45387829-5c20-4222-8f22-bcd7977846d9 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:31.334220 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-45387829-5c20-4222-8f22-bcd7977846d9 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:31.473917 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-45387829-5c20-4222-8f22-bcd7977846d9 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:31.486474 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-45387829-5c20-4222-8f22-bcd7977846d9 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1260 microversion: 2.1 time: 0.166141 Aug 31 13:01:31.487040 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 167/316] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:31 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:32.347328 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-ec90574e-0efe-48e5-802e-0bfeab94e30b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:32.347965 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-ec90574e-0efe-48e5-802e-0bfeab94e30b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: f97b98c1-e7be-4c90-8c65-715135db482b] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:32.354883 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ec90574e-0efe-48e5-802e-0bfeab94e30b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:32.355370 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ec90574e-0efe-48e5-802e-0bfeab94e30b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:32.355802 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ec90574e-0efe-48e5-802e-0bfeab94e30b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:32.356513 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ec90574e-0efe-48e5-802e-0bfeab94e30b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:32.356943 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ec90574e-0efe-48e5-802e-0bfeab94e30b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:32.357360 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ec90574e-0efe-48e5-802e-0bfeab94e30b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:32.507180 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-3bcdbd62-c71b-43f8-a27a-69e73698a3bf tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:32.507801 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-3bcdbd62-c71b-43f8-a27a-69e73698a3bf tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:32.510252 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_api:SELECT=66 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:32.515996 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3bcdbd62-c71b-43f8-a27a-69e73698a3bf tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:32.516470 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3bcdbd62-c71b-43f8-a27a-69e73698a3bf tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:32.516899 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3bcdbd62-c71b-43f8-a27a-69e73698a3bf tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:32.517586 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3bcdbd62-c71b-43f8-a27a-69e73698a3bf tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:32.518027 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3bcdbd62-c71b-43f8-a27a-69e73698a3bf tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:32.518428 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3bcdbd62-c71b-43f8-a27a-69e73698a3bf tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:32.554861 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-ec90574e-0efe-48e5-802e-0bfeab94e30b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:32.563539 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-ec90574e-0efe-48e5-802e-0bfeab94e30b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b" status: 200 len: 1521 microversion: 2.1 time: 0.220338 Aug 31 13:01:32.564274 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 150/317] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:32 2022] GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:32.662394 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-3bcdbd62-c71b-43f8-a27a-69e73698a3bf tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:32.674735 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-3bcdbd62-c71b-43f8-a27a-69e73698a3bf tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1260 microversion: 2.1 time: 0.171507 Aug 31 13:01:32.675365 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 168/318] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:32 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:33.586691 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e0d24740-8790-4f80-ae2f-b1cb27d58e11 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:33.587338 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e0d24740-8790-4f80-ae2f-b1cb27d58e11 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: f97b98c1-e7be-4c90-8c65-715135db482b] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:33.593741 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e0d24740-8790-4f80-ae2f-b1cb27d58e11 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:33.594175 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e0d24740-8790-4f80-ae2f-b1cb27d58e11 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:33.594612 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e0d24740-8790-4f80-ae2f-b1cb27d58e11 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:33.595285 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e0d24740-8790-4f80-ae2f-b1cb27d58e11 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:33.595732 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e0d24740-8790-4f80-ae2f-b1cb27d58e11 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:33.596234 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e0d24740-8790-4f80-ae2f-b1cb27d58e11 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:33.696251 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-49b83fb5-1c70-4180-9f2e-a4b81b0353bc tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:33.696916 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-49b83fb5-1c70-4180-9f2e-a4b81b0353bc tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:33.703751 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-49b83fb5-1c70-4180-9f2e-a4b81b0353bc tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:33.704267 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-49b83fb5-1c70-4180-9f2e-a4b81b0353bc tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:33.704689 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-49b83fb5-1c70-4180-9f2e-a4b81b0353bc tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:33.705370 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-49b83fb5-1c70-4180-9f2e-a4b81b0353bc tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:33.706047 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-49b83fb5-1c70-4180-9f2e-a4b81b0353bc tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:33.706463 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-49b83fb5-1c70-4180-9f2e-a4b81b0353bc tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:33.731703 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e0d24740-8790-4f80-ae2f-b1cb27d58e11 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:33.739625 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e0d24740-8790-4f80-ae2f-b1cb27d58e11 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b" status: 200 len: 1521 microversion: 2.1 time: 0.156935 Aug 31 13:01:33.740408 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 151/319] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:33 2022] GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:33.838754 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-49b83fb5-1c70-4180-9f2e-a4b81b0353bc tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:33.846919 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-49b83fb5-1c70-4180-9f2e-a4b81b0353bc tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1260 microversion: 2.1 time: 0.154453 Aug 31 13:01:33.847422 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 169/320] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:33 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:34.760776 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-37f0496c-5812-4aca-9421-91003fb76e15 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:34.761351 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-37f0496c-5812-4aca-9421-91003fb76e15 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: f97b98c1-e7be-4c90-8c65-715135db482b] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:34.768769 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-37f0496c-5812-4aca-9421-91003fb76e15 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:34.769321 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-37f0496c-5812-4aca-9421-91003fb76e15 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:34.769745 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-37f0496c-5812-4aca-9421-91003fb76e15 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:34.770489 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-37f0496c-5812-4aca-9421-91003fb76e15 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:34.771119 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-37f0496c-5812-4aca-9421-91003fb76e15 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:34.771542 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-37f0496c-5812-4aca-9421-91003fb76e15 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:34.866923 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-65b39320-f869-46ab-a29b-4b334645e3df tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:34.868168 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-65b39320-f869-46ab-a29b-4b334645e3df tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:34.875401 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-65b39320-f869-46ab-a29b-4b334645e3df tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:34.875927 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-65b39320-f869-46ab-a29b-4b334645e3df tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:34.876576 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-65b39320-f869-46ab-a29b-4b334645e3df tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:34.877433 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-65b39320-f869-46ab-a29b-4b334645e3df tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:34.878094 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-65b39320-f869-46ab-a29b-4b334645e3df tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:34.878706 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-65b39320-f869-46ab-a29b-4b334645e3df tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:34.899895 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:35.036761 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-37f0496c-5812-4aca-9421-91003fb76e15 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:35.045764 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-37f0496c-5812-4aca-9421-91003fb76e15 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b" status: 200 len: 1521 microversion: 2.1 time: 0.288415 Aug 31 13:01:35.046134 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 152/321] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:34 2022] GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:35.136405 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-65b39320-f869-46ab-a29b-4b334645e3df tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:35.145367 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-65b39320-f869-46ab-a29b-4b334645e3df tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1260 microversion: 2.1 time: 0.282469 Aug 31 13:01:35.157994 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 170/322] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:34 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1260 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:01:36.066595 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e38bfa6a-2439-4728-baa9-2750b5731723 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:36.068256 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e38bfa6a-2439-4728-baa9-2750b5731723 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: f97b98c1-e7be-4c90-8c65-715135db482b] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:36.075248 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e38bfa6a-2439-4728-baa9-2750b5731723 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:36.075729 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e38bfa6a-2439-4728-baa9-2750b5731723 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:36.076179 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e38bfa6a-2439-4728-baa9-2750b5731723 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:36.077106 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e38bfa6a-2439-4728-baa9-2750b5731723 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:36.077696 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e38bfa6a-2439-4728-baa9-2750b5731723 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:36.078315 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e38bfa6a-2439-4728-baa9-2750b5731723 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:36.167459 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-5841e761-28e7-4801-acab-c4aac45ff251 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:36.168182 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-5841e761-28e7-4801-acab-c4aac45ff251 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:36.176362 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5841e761-28e7-4801-acab-c4aac45ff251 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:36.177553 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5841e761-28e7-4801-acab-c4aac45ff251 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:36.178604 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5841e761-28e7-4801-acab-c4aac45ff251 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:36.179920 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5841e761-28e7-4801-acab-c4aac45ff251 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:36.180914 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5841e761-28e7-4801-acab-c4aac45ff251 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:36.181560 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5841e761-28e7-4801-acab-c4aac45ff251 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:36.223575 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e38bfa6a-2439-4728-baa9-2750b5731723 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:36.241668 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e38bfa6a-2439-4728-baa9-2750b5731723 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b" status: 200 len: 1521 microversion: 2.1 time: 0.178890 Aug 31 13:01:36.247237 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 153/323] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:36 2022] GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:36.355759 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-5841e761-28e7-4801-acab-c4aac45ff251 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:36.367746 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-5841e761-28e7-4801-acab-c4aac45ff251 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1260 microversion: 2.1 time: 0.205174 Aug 31 13:01:36.368891 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 171/324] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:36 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1260 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:01:37.269275 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-975ce48f-5721-4513-8715-8577b0789939 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:37.269868 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-975ce48f-5721-4513-8715-8577b0789939 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: f97b98c1-e7be-4c90-8c65-715135db482b] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:37.276456 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-975ce48f-5721-4513-8715-8577b0789939 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:37.276935 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-975ce48f-5721-4513-8715-8577b0789939 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:37.277360 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-975ce48f-5721-4513-8715-8577b0789939 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:37.278045 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-975ce48f-5721-4513-8715-8577b0789939 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:37.278659 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-975ce48f-5721-4513-8715-8577b0789939 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:37.279086 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-975ce48f-5721-4513-8715-8577b0789939 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:37.392013 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-3a4b82ea-64ee-475e-873a-33b343fc6600 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:37.393484 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-3a4b82ea-64ee-475e-873a-33b343fc6600 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:37.412326 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3a4b82ea-64ee-475e-873a-33b343fc6600 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:37.413118 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3a4b82ea-64ee-475e-873a-33b343fc6600 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:37.413550 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3a4b82ea-64ee-475e-873a-33b343fc6600 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:37.414248 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3a4b82ea-64ee-475e-873a-33b343fc6600 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:37.415328 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3a4b82ea-64ee-475e-873a-33b343fc6600 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:37.415328 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3a4b82ea-64ee-475e-873a-33b343fc6600 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:37.444927 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-975ce48f-5721-4513-8715-8577b0789939 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:37.454870 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-975ce48f-5721-4513-8715-8577b0789939 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b" status: 200 len: 1521 microversion: 2.1 time: 0.191455 Aug 31 13:01:37.456156 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 154/325] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:37 2022] GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:37.569820 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-3a4b82ea-64ee-475e-873a-33b343fc6600 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:37.579086 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-3a4b82ea-64ee-475e-873a-33b343fc6600 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1260 microversion: 2.1 time: 0.193099 Aug 31 13:01:37.580243 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 172/326] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:37 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1260 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:38.475765 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e044c296-cdb3-4519-8c59-5730ac05fc56 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:38.476790 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e044c296-cdb3-4519-8c59-5730ac05fc56 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: f97b98c1-e7be-4c90-8c65-715135db482b] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:38.486254 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e044c296-cdb3-4519-8c59-5730ac05fc56 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:38.487127 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e044c296-cdb3-4519-8c59-5730ac05fc56 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:38.487663 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e044c296-cdb3-4519-8c59-5730ac05fc56 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:38.488624 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e044c296-cdb3-4519-8c59-5730ac05fc56 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:38.489194 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e044c296-cdb3-4519-8c59-5730ac05fc56 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:38.489677 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e044c296-cdb3-4519-8c59-5730ac05fc56 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:38.600853 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-f2564562-1e7b-4cb9-b726-b945bf777914 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:38.601458 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-f2564562-1e7b-4cb9-b726-b945bf777914 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:38.608555 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f2564562-1e7b-4cb9-b726-b945bf777914 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:38.609016 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f2564562-1e7b-4cb9-b726-b945bf777914 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:38.609441 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f2564562-1e7b-4cb9-b726-b945bf777914 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:38.610285 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f2564562-1e7b-4cb9-b726-b945bf777914 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:38.610773 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f2564562-1e7b-4cb9-b726-b945bf777914 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:38.611492 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f2564562-1e7b-4cb9-b726-b945bf777914 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:38.629632 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e044c296-cdb3-4519-8c59-5730ac05fc56 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:38.637481 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e044c296-cdb3-4519-8c59-5730ac05fc56 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b" status: 200 len: 1521 microversion: 2.1 time: 0.166100 Aug 31 13:01:38.638049 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 155/327] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:38 2022] GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:38.998301 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-f2564562-1e7b-4cb9-b726-b945bf777914 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:39.008127 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-f2564562-1e7b-4cb9-b726-b945bf777914 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1260 microversion: 2.1 time: 0.411159 Aug 31 13:01:39.009151 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 173/328] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:38 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1260 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:01:39.658806 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-be2f2703-aea2-43f8-ba77-8e0980d45c6d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:39.659514 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-be2f2703-aea2-43f8-ba77-8e0980d45c6d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: f97b98c1-e7be-4c90-8c65-715135db482b] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:39.661355 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:39.667516 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-be2f2703-aea2-43f8-ba77-8e0980d45c6d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:39.668046 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-be2f2703-aea2-43f8-ba77-8e0980d45c6d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:39.668554 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-be2f2703-aea2-43f8-ba77-8e0980d45c6d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:39.669232 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-be2f2703-aea2-43f8-ba77-8e0980d45c6d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:39.669671 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-be2f2703-aea2-43f8-ba77-8e0980d45c6d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:39.670081 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-be2f2703-aea2-43f8-ba77-8e0980d45c6d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:39.807141 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-be2f2703-aea2-43f8-ba77-8e0980d45c6d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:39.816948 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-be2f2703-aea2-43f8-ba77-8e0980d45c6d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b" status: 200 len: 1521 microversion: 2.1 time: 0.162104 Aug 31 13:01:39.817713 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 156/329] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:39 2022] GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:40.029543 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-a9ec2f38-e163-4bf9-b0b0-24cd40999ac7 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:40.030057 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-a9ec2f38-e163-4bf9-b0b0-24cd40999ac7 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:40.036853 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a9ec2f38-e163-4bf9-b0b0-24cd40999ac7 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:40.037352 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a9ec2f38-e163-4bf9-b0b0-24cd40999ac7 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:40.038105 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a9ec2f38-e163-4bf9-b0b0-24cd40999ac7 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:40.038814 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a9ec2f38-e163-4bf9-b0b0-24cd40999ac7 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:40.039260 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a9ec2f38-e163-4bf9-b0b0-24cd40999ac7 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:40.039683 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a9ec2f38-e163-4bf9-b0b0-24cd40999ac7 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:40.179363 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-a9ec2f38-e163-4bf9-b0b0-24cd40999ac7 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:40.191475 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-a9ec2f38-e163-4bf9-b0b0-24cd40999ac7 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1260 microversion: 2.1 time: 0.165684 Aug 31 13:01:40.192359 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 174/330] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:40 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:40.844325 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-5de2d3a3-ae7c-4da8-b210-c0b41924a8ae tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:40.845305 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-5de2d3a3-ae7c-4da8-b210-c0b41924a8ae tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: f97b98c1-e7be-4c90-8c65-715135db482b] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:40.853006 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5de2d3a3-ae7c-4da8-b210-c0b41924a8ae tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:40.853495 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5de2d3a3-ae7c-4da8-b210-c0b41924a8ae tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:40.853929 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5de2d3a3-ae7c-4da8-b210-c0b41924a8ae tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:40.854621 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5de2d3a3-ae7c-4da8-b210-c0b41924a8ae tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:40.855068 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5de2d3a3-ae7c-4da8-b210-c0b41924a8ae tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:40.855487 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5de2d3a3-ae7c-4da8-b210-c0b41924a8ae tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:40.987736 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-5de2d3a3-ae7c-4da8-b210-c0b41924a8ae tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:40.995385 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-5de2d3a3-ae7c-4da8-b210-c0b41924a8ae tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b" status: 200 len: 1521 microversion: 2.1 time: 0.157774 Aug 31 13:01:40.996005 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 157/331] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:40 2022] GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:41.216676 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-b05b96d2-81cc-4aae-bfe2-f123b94bc35e tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:41.217714 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-b05b96d2-81cc-4aae-bfe2-f123b94bc35e tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:41.226859 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b05b96d2-81cc-4aae-bfe2-f123b94bc35e tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:41.227335 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b05b96d2-81cc-4aae-bfe2-f123b94bc35e tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:41.227754 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b05b96d2-81cc-4aae-bfe2-f123b94bc35e tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:41.228597 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b05b96d2-81cc-4aae-bfe2-f123b94bc35e tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:41.229099 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b05b96d2-81cc-4aae-bfe2-f123b94bc35e tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:41.229531 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b05b96d2-81cc-4aae-bfe2-f123b94bc35e tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:41.374728 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-b05b96d2-81cc-4aae-bfe2-f123b94bc35e tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:41.383205 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-b05b96d2-81cc-4aae-bfe2-f123b94bc35e tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1260 microversion: 2.1 time: 0.173115 Aug 31 13:01:41.383783 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 175/332] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:41 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:42.016864 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-6e1953df-e2d2-41b4-8b4b-0fa2b552f412 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:42.017503 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-6e1953df-e2d2-41b4-8b4b-0fa2b552f412 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: f97b98c1-e7be-4c90-8c65-715135db482b] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:42.025467 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6e1953df-e2d2-41b4-8b4b-0fa2b552f412 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:42.026073 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6e1953df-e2d2-41b4-8b4b-0fa2b552f412 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:42.026498 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6e1953df-e2d2-41b4-8b4b-0fa2b552f412 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:42.027214 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6e1953df-e2d2-41b4-8b4b-0fa2b552f412 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:42.027668 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6e1953df-e2d2-41b4-8b4b-0fa2b552f412 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:42.028105 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6e1953df-e2d2-41b4-8b4b-0fa2b552f412 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:42.164435 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-6e1953df-e2d2-41b4-8b4b-0fa2b552f412 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:42.172338 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-6e1953df-e2d2-41b4-8b4b-0fa2b552f412 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b" status: 200 len: 1521 microversion: 2.1 time: 0.159756 Aug 31 13:01:42.172898 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 158/333] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:42 2022] GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:42.408258 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-fc7bd51e-a0f2-402e-809f-c8ee51bb555a tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:42.409106 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-fc7bd51e-a0f2-402e-809f-c8ee51bb555a tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:42.420402 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fc7bd51e-a0f2-402e-809f-c8ee51bb555a tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:42.421183 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fc7bd51e-a0f2-402e-809f-c8ee51bb555a tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:42.421879 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fc7bd51e-a0f2-402e-809f-c8ee51bb555a tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:42.422994 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fc7bd51e-a0f2-402e-809f-c8ee51bb555a tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:42.423728 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fc7bd51e-a0f2-402e-809f-c8ee51bb555a tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:42.424466 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fc7bd51e-a0f2-402e-809f-c8ee51bb555a tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:42.583316 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-fc7bd51e-a0f2-402e-809f-c8ee51bb555a tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:42.591886 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-fc7bd51e-a0f2-402e-809f-c8ee51bb555a tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1260 microversion: 2.1 time: 0.190212 Aug 31 13:01:42.592462 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 176/334] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:42 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1260 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:43.198285 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-5e7e9ae4-89c2-4bd0-914c-0743a660a8c5 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:43.199301 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-5e7e9ae4-89c2-4bd0-914c-0743a660a8c5 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: f97b98c1-e7be-4c90-8c65-715135db482b] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:43.209349 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5e7e9ae4-89c2-4bd0-914c-0743a660a8c5 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:43.209831 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5e7e9ae4-89c2-4bd0-914c-0743a660a8c5 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:43.210276 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5e7e9ae4-89c2-4bd0-914c-0743a660a8c5 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:43.210966 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5e7e9ae4-89c2-4bd0-914c-0743a660a8c5 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:43.211450 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5e7e9ae4-89c2-4bd0-914c-0743a660a8c5 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:43.211882 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5e7e9ae4-89c2-4bd0-914c-0743a660a8c5 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:43.347160 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-5e7e9ae4-89c2-4bd0-914c-0743a660a8c5 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:43.359166 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-5e7e9ae4-89c2-4bd0-914c-0743a660a8c5 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b" status: 200 len: 1521 microversion: 2.1 time: 0.167922 Aug 31 13:01:43.360070 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 159/335] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:43 2022] GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:43.613757 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-b4938445-294b-4321-aebf-236cfc331819 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:43.614296 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-b4938445-294b-4321-aebf-236cfc331819 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:43.621131 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b4938445-294b-4321-aebf-236cfc331819 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:43.621603 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b4938445-294b-4321-aebf-236cfc331819 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:43.622036 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b4938445-294b-4321-aebf-236cfc331819 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:43.622727 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b4938445-294b-4321-aebf-236cfc331819 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:43.623163 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b4938445-294b-4321-aebf-236cfc331819 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:43.623578 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b4938445-294b-4321-aebf-236cfc331819 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:43.775466 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-b4938445-294b-4321-aebf-236cfc331819 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:43.783237 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-b4938445-294b-4321-aebf-236cfc331819 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1260 microversion: 2.1 time: 0.173606 Aug 31 13:01:43.783804 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 177/336] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:43 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:44.381846 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-97bbc16a-d58f-4e71-ab11-c28cb27163e5 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:44.382505 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-97bbc16a-d58f-4e71-ab11-c28cb27163e5 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: f97b98c1-e7be-4c90-8c65-715135db482b] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:44.388861 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-97bbc16a-d58f-4e71-ab11-c28cb27163e5 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:44.389330 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-97bbc16a-d58f-4e71-ab11-c28cb27163e5 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:44.389750 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-97bbc16a-d58f-4e71-ab11-c28cb27163e5 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:44.390429 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-97bbc16a-d58f-4e71-ab11-c28cb27163e5 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:44.390922 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-97bbc16a-d58f-4e71-ab11-c28cb27163e5 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:44.391563 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-97bbc16a-d58f-4e71-ab11-c28cb27163e5 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:44.526227 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-97bbc16a-d58f-4e71-ab11-c28cb27163e5 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:44.534151 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-97bbc16a-d58f-4e71-ab11-c28cb27163e5 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b" status: 200 len: 1521 microversion: 2.1 time: 0.156338 Aug 31 13:01:44.534734 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 160/337] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:44 2022] GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:44.806526 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-3c8a67ee-4faa-4c0b-82dc-7a9b782f74cd tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:44.807099 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-3c8a67ee-4faa-4c0b-82dc-7a9b782f74cd tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:44.814804 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3c8a67ee-4faa-4c0b-82dc-7a9b782f74cd tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:44.815388 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3c8a67ee-4faa-4c0b-82dc-7a9b782f74cd tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:44.815858 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3c8a67ee-4faa-4c0b-82dc-7a9b782f74cd tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:44.816626 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3c8a67ee-4faa-4c0b-82dc-7a9b782f74cd tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:44.817147 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3c8a67ee-4faa-4c0b-82dc-7a9b782f74cd tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:44.817608 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3c8a67ee-4faa-4c0b-82dc-7a9b782f74cd tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:44.956493 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-3c8a67ee-4faa-4c0b-82dc-7a9b782f74cd tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:44.964593 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-3c8a67ee-4faa-4c0b-82dc-7a9b782f74cd tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1260 microversion: 2.1 time: 0.163235 Aug 31 13:01:44.965179 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 178/338] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:44 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:45.556254 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-cb3b6594-b151-40ba-bb51-2dca0371b403 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:45.557475 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-cb3b6594-b151-40ba-bb51-2dca0371b403 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: f97b98c1-e7be-4c90-8c65-715135db482b] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:45.563560 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cb3b6594-b151-40ba-bb51-2dca0371b403 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:45.564109 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cb3b6594-b151-40ba-bb51-2dca0371b403 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:45.564539 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cb3b6594-b151-40ba-bb51-2dca0371b403 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:45.565229 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cb3b6594-b151-40ba-bb51-2dca0371b403 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:45.565747 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cb3b6594-b151-40ba-bb51-2dca0371b403 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:45.566161 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cb3b6594-b151-40ba-bb51-2dca0371b403 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:45.708119 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-cb3b6594-b151-40ba-bb51-2dca0371b403 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:45.718983 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-cb3b6594-b151-40ba-bb51-2dca0371b403 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b" status: 200 len: 1521 microversion: 2.1 time: 0.166596 Aug 31 13:01:45.719937 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 161/339] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:45 2022] GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:45.988742 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-92ee981a-caf9-4b9d-b8e2-4e4b64f60ca0 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:45.990145 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-92ee981a-caf9-4b9d-b8e2-4e4b64f60ca0 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:46.000897 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-92ee981a-caf9-4b9d-b8e2-4e4b64f60ca0 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:46.001679 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-92ee981a-caf9-4b9d-b8e2-4e4b64f60ca0 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:46.002346 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-92ee981a-caf9-4b9d-b8e2-4e4b64f60ca0 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:46.003888 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-92ee981a-caf9-4b9d-b8e2-4e4b64f60ca0 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:46.004618 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-92ee981a-caf9-4b9d-b8e2-4e4b64f60ca0 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:46.005309 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-92ee981a-caf9-4b9d-b8e2-4e4b64f60ca0 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:46.177682 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-92ee981a-caf9-4b9d-b8e2-4e4b64f60ca0 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:46.185643 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-92ee981a-caf9-4b9d-b8e2-4e4b64f60ca0 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1260 microversion: 2.1 time: 0.203555 Aug 31 13:01:46.186219 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 179/340] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:45 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1260 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:46.746082 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-9dd91e1e-7448-4f20-9a7b-eaf45fba8cae tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:46.746651 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-9dd91e1e-7448-4f20-9a7b-eaf45fba8cae tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: f97b98c1-e7be-4c90-8c65-715135db482b] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:46.755801 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9dd91e1e-7448-4f20-9a7b-eaf45fba8cae tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:46.756440 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9dd91e1e-7448-4f20-9a7b-eaf45fba8cae tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:46.756876 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9dd91e1e-7448-4f20-9a7b-eaf45fba8cae tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:46.757554 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9dd91e1e-7448-4f20-9a7b-eaf45fba8cae tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:46.758001 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9dd91e1e-7448-4f20-9a7b-eaf45fba8cae tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:46.758420 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9dd91e1e-7448-4f20-9a7b-eaf45fba8cae tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:46.774235 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=100 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:46.897463 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-9dd91e1e-7448-4f20-9a7b-eaf45fba8cae tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:46.905870 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-9dd91e1e-7448-4f20-9a7b-eaf45fba8cae tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b" status: 200 len: 1521 microversion: 2.1 time: 0.166516 Aug 31 13:01:46.906556 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 162/341] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:46 2022] GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:47.206672 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-b4ef86e8-a918-4b3f-9f6c-039477770eb5 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:47.207283 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-b4ef86e8-a918-4b3f-9f6c-039477770eb5 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:47.213927 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b4ef86e8-a918-4b3f-9f6c-039477770eb5 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:47.214404 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b4ef86e8-a918-4b3f-9f6c-039477770eb5 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:47.214831 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b4ef86e8-a918-4b3f-9f6c-039477770eb5 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:47.215513 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b4ef86e8-a918-4b3f-9f6c-039477770eb5 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:47.215995 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b4ef86e8-a918-4b3f-9f6c-039477770eb5 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:47.216437 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b4ef86e8-a918-4b3f-9f6c-039477770eb5 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:47.355729 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-b4ef86e8-a918-4b3f-9f6c-039477770eb5 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:47.367285 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-b4ef86e8-a918-4b3f-9f6c-039477770eb5 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1260 microversion: 2.1 time: 0.164661 Aug 31 13:01:47.368064 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 180/342] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:47 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:47.927572 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-955ec5bb-fc0d-41cf-a7b9-e0e84c5e4597 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:47.928225 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-955ec5bb-fc0d-41cf-a7b9-e0e84c5e4597 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: f97b98c1-e7be-4c90-8c65-715135db482b] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:47.940454 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-955ec5bb-fc0d-41cf-a7b9-e0e84c5e4597 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:47.940454 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-955ec5bb-fc0d-41cf-a7b9-e0e84c5e4597 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:47.940454 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-955ec5bb-fc0d-41cf-a7b9-e0e84c5e4597 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:47.940454 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-955ec5bb-fc0d-41cf-a7b9-e0e84c5e4597 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:47.940843 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-955ec5bb-fc0d-41cf-a7b9-e0e84c5e4597 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:47.940843 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-955ec5bb-fc0d-41cf-a7b9-e0e84c5e4597 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:48.084609 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-955ec5bb-fc0d-41cf-a7b9-e0e84c5e4597 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:48.092822 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-955ec5bb-fc0d-41cf-a7b9-e0e84c5e4597 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b" status: 200 len: 1521 microversion: 2.1 time: 0.169195 Aug 31 13:01:48.093519 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 163/343] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:47 2022] GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:48.393985 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-e893d448-bdca-4ec8-87ab-16f248fcd81b tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:48.395440 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-e893d448-bdca-4ec8-87ab-16f248fcd81b tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:48.402483 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e893d448-bdca-4ec8-87ab-16f248fcd81b tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:48.403119 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e893d448-bdca-4ec8-87ab-16f248fcd81b tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:48.403648 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e893d448-bdca-4ec8-87ab-16f248fcd81b tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:48.404462 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e893d448-bdca-4ec8-87ab-16f248fcd81b tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:48.404978 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e893d448-bdca-4ec8-87ab-16f248fcd81b tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:48.405493 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e893d448-bdca-4ec8-87ab-16f248fcd81b tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:48.541866 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-e893d448-bdca-4ec8-87ab-16f248fcd81b tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:48.549864 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-e893d448-bdca-4ec8-87ab-16f248fcd81b tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1260 microversion: 2.1 time: 0.160450 Aug 31 13:01:48.550456 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 181/344] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:48 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:49.115061 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-29d1c9cb-a3d8-4862-bc8f-16919dc72d58 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:49.116017 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-29d1c9cb-a3d8-4862-bc8f-16919dc72d58 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: f97b98c1-e7be-4c90-8c65-715135db482b] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:49.122527 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-29d1c9cb-a3d8-4862-bc8f-16919dc72d58 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:49.123008 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-29d1c9cb-a3d8-4862-bc8f-16919dc72d58 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:49.123428 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-29d1c9cb-a3d8-4862-bc8f-16919dc72d58 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:49.124138 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-29d1c9cb-a3d8-4862-bc8f-16919dc72d58 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:49.124570 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-29d1c9cb-a3d8-4862-bc8f-16919dc72d58 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:49.124977 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-29d1c9cb-a3d8-4862-bc8f-16919dc72d58 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:49.280404 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-29d1c9cb-a3d8-4862-bc8f-16919dc72d58 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:49.289681 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-29d1c9cb-a3d8-4862-bc8f-16919dc72d58 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b" status: 200 len: 1501 microversion: 2.1 time: 0.179000 Aug 31 13:01:49.290328 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 164/345] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:49 2022] GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b => generated 1501 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:49.318895 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-7bfc9355-0b17-49cf-b5dd-5fc0fb19df97 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b8120300-3f6e-480e-bca2-ad0b122febcb"}} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:01:49.322154 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-7bfc9355-0b17-49cf-b5dd-5fc0fb19df97 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: f97b98c1-e7be-4c90-8c65-715135db482b] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:49.328673 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7bfc9355-0b17-49cf-b5dd-5fc0fb19df97 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:49.329330 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7bfc9355-0b17-49cf-b5dd-5fc0fb19df97 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:49.329747 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7bfc9355-0b17-49cf-b5dd-5fc0fb19df97 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:49.330606 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7bfc9355-0b17-49cf-b5dd-5fc0fb19df97 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:49.331050 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7bfc9355-0b17-49cf-b5dd-5fc0fb19df97 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:49.331461 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7bfc9355-0b17-49cf-b5dd-5fc0fb19df97 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:49.357427 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.wsgi [None req-7bfc9355-0b17-49cf-b5dd-5fc0fb19df97 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] HTTP exception thrown: Cannot 'attach_volume' instance f97b98c1-e7be-4c90-8c65-715135db482b while it is in vm_state rescued Aug 31 13:01:49.359459 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-7bfc9355-0b17-49cf-b5dd-5fc0fb19df97 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Request method failure captured: Aug 31 13:01:49.359459 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: request: POST /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b/os-volume_attachments HTTP/1.1 Aug 31 13:01:49.359459 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept: application/json Aug 31 13:01:49.359459 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept-Encoding: identity Aug 31 13:01:49.359459 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Connection: close Aug 31 13:01:49.359459 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Length: 74 Aug 31 13:01:49.359459 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Type: application/json Aug 31 13:01:49.359459 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Host: 10.222.0.58 Aug 31 13:01:49.359459 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Openstack-System-Scope: None Aug 31 13:01:49.359459 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: User-Agent: python-urllib3/1.26.12 Aug 31 13:01:49.359459 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Auth-Token: gAAAAABjD1sZ8K-CuXjoyInmbyCWcKQ2hvstKdaDVHuGOcX86HAp1ceK2FrO69nhO1vsmo_DJ17VxZ7XFBhtbbOOVHhczRe79dWAWnBV79vGZeTskL4gRVzpkATTbtMz8tRcPwNEiHgyNNxRUIMKgIXrh9QhenjZON35FkHfV2_WQxqR1mNYfOg Aug 31 13:01:49.359459 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Id: None Aug 31 13:01:49.359459 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Name: None Aug 31 13:01:49.359459 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Identity-Status: Confirmed Aug 31 13:01:49.359459 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Is-Admin-Project: True Aug 31 13:01:49.359459 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Id: default Aug 31 13:01:49.359459 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Name: Default Aug 31 13:01:49.359459 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Id: b5b2950890c04cff868553069d6aba9a Aug 31 13:01:49.359459 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1816283264 Aug 31 13:01:49.359459 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Role: member,reader Aug 31 13:01:49.359459 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Roles: member,reader Aug 31 13:01:49.361238 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b5b2950890c04cff868553069d6aba9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b5b2950890c04cff868553069d6aba9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b5b2950890c04cff868553069d6aba9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b5b2950890c04cff868553069d6aba9a"}]}] Aug 31 13:01:49.361238 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1816283264 Aug 31 13:01:49.361238 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Id: b5b2950890c04cff868553069d6aba9a Aug 31 13:01:49.361238 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1816283264 Aug 31 13:01:49.361238 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User: tempest-ServerRescueNegativeTestJSON-1816283264-project Aug 31 13:01:49.361238 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Id: default Aug 31 13:01:49.361238 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Name: Default Aug 31 13:01:49.361238 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Id: 32770594db4f437a958fd8c2c145a865 Aug 31 13:01:49.361238 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1816283264-project Aug 31 13:01:49.361238 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Aug 31 13:01:49.361238 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: {"volumeAttachment": {"volumeId": "b8120300-3f6e-480e-bca2-ad0b122febcb"}} Aug 31 13:01:49.361238 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: method: > Aug 31 13:01:49.362392 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: exception: Cannot 'attach_volume' instance f97b98c1-e7be-4c90-8c65-715135db482b while it is in vm_state rescued Aug 31 13:01:49.362392 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: action_args: {'server_id': 'f97b98c1-e7be-4c90-8c65-715135db482b', 'body': {'volumeAttachment': {'volumeId': 'b8120300-3f6e-480e-bca2-ad0b122febcb'}}} Aug 31 13:01:49.362392 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:01:49.362392 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:01:49.362392 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 13:01:49.362392 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 13:01:49.362392 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 13:01:49.362392 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 13:01:49.362392 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 13:01:49.362392 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 13:01:49.362392 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f97b98c1-e7be-4c90-8c65-715135db482b in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 31 13:01:49.362392 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:01:49.362392 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:01:49.362392 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:01:49.362392 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:01:49.362392 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:01:49.362392 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:01:49.362392 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:01:49.362392 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:01:49.363722 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:01:49.363722 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:01:49.363722 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 13:01:49.363722 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 13:01:49.363722 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 13:01:49.363722 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 13:01:49.363722 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 13:01:49.363722 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 13:01:49.363722 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 31 13:01:49.363722 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 13:01:49.363722 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 13:01:49.363722 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 13:01:49.363722 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f97b98c1-e7be-4c90-8c65-715135db482b while it is in vm_state rescued Aug 31 13:01:49.363722 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:01:49.363722 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:01:49.363722 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:01:49.363722 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:01:49.363722 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:01:49.363722 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:01:49.365062 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:01:49.365062 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:01:49.365062 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f97b98c1-e7be-4c90-8c65-715135db482b while it is in vm_state rescued Aug 31 13:01:49.365062 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:01:49.366458 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-7bfc9355-0b17-49cf-b5dd-5fc0fb19df97 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Returning 409 to user: Cannot 'attach_volume' instance f97b98c1-e7be-4c90-8c65-715135db482b while it is in vm_state rescued {{(pid=120704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:01:49.367511 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-7bfc9355-0b17-49cf-b5dd-5fc0fb19df97 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "POST /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.052893 Aug 31 13:01:49.368292 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 182/346] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 31 13:01:49 2022] POST /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b/os-volume_attachments => generated 152 bytes in 54 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 31 13:01:49.377531 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-95c70723-3ef3-4ac5-99d0-795bf4d67ec6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:01:49.378063 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-95c70723-3ef3-4ac5-99d0-795bf4d67ec6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: f97b98c1-e7be-4c90-8c65-715135db482b] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:49.385702 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-95c70723-3ef3-4ac5-99d0-795bf4d67ec6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:49.386904 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-95c70723-3ef3-4ac5-99d0-795bf4d67ec6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:49.387352 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-95c70723-3ef3-4ac5-99d0-795bf4d67ec6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:49.388095 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-95c70723-3ef3-4ac5-99d0-795bf4d67ec6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:49.388543 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-95c70723-3ef3-4ac5-99d0-795bf4d67ec6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:49.388959 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-95c70723-3ef3-4ac5-99d0-795bf4d67ec6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:49.475191 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-95c70723-3ef3-4ac5-99d0-795bf4d67ec6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "POST /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b/action" status: 202 len: 0 microversion: 2.1 time: 0.101623 Aug 31 13:01:49.476490 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 165/347] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 31 13:01:49 2022] POST /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 13:01:49.484684 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-cd95ce4f-36ba-4bb8-93d0-f948f193b9af tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:49.485896 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-cd95ce4f-36ba-4bb8-93d0-f948f193b9af tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: f97b98c1-e7be-4c90-8c65-715135db482b] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:49.493453 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cd95ce4f-36ba-4bb8-93d0-f948f193b9af tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:49.494277 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cd95ce4f-36ba-4bb8-93d0-f948f193b9af tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:49.494708 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cd95ce4f-36ba-4bb8-93d0-f948f193b9af tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:49.495406 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cd95ce4f-36ba-4bb8-93d0-f948f193b9af tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:49.495915 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cd95ce4f-36ba-4bb8-93d0-f948f193b9af tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:49.496646 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cd95ce4f-36ba-4bb8-93d0-f948f193b9af tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:49.571183 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-5efc6dc2-f09b-40e0-bb52-7990d5271d5c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:49.572226 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-5efc6dc2-f09b-40e0-bb52-7990d5271d5c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:49.579707 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5efc6dc2-f09b-40e0-bb52-7990d5271d5c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:49.580480 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5efc6dc2-f09b-40e0-bb52-7990d5271d5c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:49.581087 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5efc6dc2-f09b-40e0-bb52-7990d5271d5c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:49.581954 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5efc6dc2-f09b-40e0-bb52-7990d5271d5c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:49.582543 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5efc6dc2-f09b-40e0-bb52-7990d5271d5c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:49.583122 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5efc6dc2-f09b-40e0-bb52-7990d5271d5c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:49.839474 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-cd95ce4f-36ba-4bb8-93d0-f948f193b9af tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:49.851207 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-cd95ce4f-36ba-4bb8-93d0-f948f193b9af tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b" status: 200 len: 1509 microversion: 2.1 time: 0.370117 Aug 31 13:01:49.851946 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 183/348] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:49 2022] GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b => generated 1509 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:49.877347 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-a313a057-d4a0-41bf-b679-af9fb9197b9a req-1268b2e7-3a77-4920-a269-a6c443c68602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e792077-8a21-48f8-8f65-ce1a4aae8c0a", "name": "network-vif-plugged", "status": "completed", "tag": "22506bf3-0225-4ad3-b8d6-55645f334201"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:01:49.889699 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-a313a057-d4a0-41bf-b679-af9fb9197b9a req-1268b2e7-3a77-4920-a269-a6c443c68602 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:49.890041 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-5efc6dc2-f09b-40e0-bb52-7990d5271d5c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:49.890908 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-a313a057-d4a0-41bf-b679-af9fb9197b9a req-1268b2e7-3a77-4920-a269-a6c443c68602 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:49.891588 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-a313a057-d4a0-41bf-b679-af9fb9197b9a req-1268b2e7-3a77-4920-a269-a6c443c68602 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:49.902346 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-5efc6dc2-f09b-40e0-bb52-7990d5271d5c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1260 microversion: 2.1 time: 0.335546 Aug 31 13:01:49.917456 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 166/349] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:49 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1260 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:49.928423 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-a313a057-d4a0-41bf-b679-af9fb9197b9a req-1268b2e7-3a77-4920-a269-a6c443c68602 service nova] Creating event network-vif-plugged:22506bf3-0225-4ad3-b8d6-55645f334201 for instance 9e792077-8a21-48f8-8f65-ce1a4aae8c0a on hv-cinder-85442 Aug 31 13:01:49.932967 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-a313a057-d4a0-41bf-b679-af9fb9197b9a req-1268b2e7-3a77-4920-a269-a6c443c68602 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058698 Aug 31 13:01:49.933894 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 184/350] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:01:50.872349 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e720a377-d11a-4607-8bb0-d350352908b1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:50.872966 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e720a377-d11a-4607-8bb0-d350352908b1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: f97b98c1-e7be-4c90-8c65-715135db482b] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:50.879074 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e720a377-d11a-4607-8bb0-d350352908b1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:50.879559 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e720a377-d11a-4607-8bb0-d350352908b1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:50.880050 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e720a377-d11a-4607-8bb0-d350352908b1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:50.880739 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e720a377-d11a-4607-8bb0-d350352908b1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:50.881258 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e720a377-d11a-4607-8bb0-d350352908b1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:50.881780 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e720a377-d11a-4607-8bb0-d350352908b1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:50.933299 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-eb8b5aa8-d04c-4849-8715-0f384dc7fe5f tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:50.934723 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-eb8b5aa8-d04c-4849-8715-0f384dc7fe5f tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:50.945439 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-eb8b5aa8-d04c-4849-8715-0f384dc7fe5f tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:50.946162 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-eb8b5aa8-d04c-4849-8715-0f384dc7fe5f tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:50.946793 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-eb8b5aa8-d04c-4849-8715-0f384dc7fe5f tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:50.947723 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-eb8b5aa8-d04c-4849-8715-0f384dc7fe5f tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:50.948556 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-eb8b5aa8-d04c-4849-8715-0f384dc7fe5f tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:50.949175 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-eb8b5aa8-d04c-4849-8715-0f384dc7fe5f tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:51.092973 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e720a377-d11a-4607-8bb0-d350352908b1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:51.102564 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e720a377-d11a-4607-8bb0-d350352908b1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b" status: 200 len: 1509 microversion: 2.1 time: 0.233377 Aug 31 13:01:51.103872 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 167/351] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:50 2022] GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b => generated 1509 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:51.122294 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-eb8b5aa8-d04c-4849-8715-0f384dc7fe5f tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:51.130532 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-eb8b5aa8-d04c-4849-8715-0f384dc7fe5f tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1260 microversion: 2.1 time: 0.205055 Aug 31 13:01:51.131331 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 185/352] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:50 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1260 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:01:52.124790 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-bda2979a-a352-42ed-bafc-ba2d77deeeb6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:52.125398 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-bda2979a-a352-42ed-bafc-ba2d77deeeb6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: f97b98c1-e7be-4c90-8c65-715135db482b] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:52.138465 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bda2979a-a352-42ed-bafc-ba2d77deeeb6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:52.139529 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bda2979a-a352-42ed-bafc-ba2d77deeeb6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:52.139986 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bda2979a-a352-42ed-bafc-ba2d77deeeb6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:52.140688 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bda2979a-a352-42ed-bafc-ba2d77deeeb6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:52.141120 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bda2979a-a352-42ed-bafc-ba2d77deeeb6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:52.143458 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bda2979a-a352-42ed-bafc-ba2d77deeeb6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:52.155747 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-eabb1ca3-aedc-4e6f-87ee-132bad9efec4 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:52.157865 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-eabb1ca3-aedc-4e6f-87ee-132bad9efec4 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:52.169067 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-eabb1ca3-aedc-4e6f-87ee-132bad9efec4 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:52.169862 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-eabb1ca3-aedc-4e6f-87ee-132bad9efec4 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:52.170377 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-eabb1ca3-aedc-4e6f-87ee-132bad9efec4 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:52.173447 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-eabb1ca3-aedc-4e6f-87ee-132bad9efec4 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:52.174149 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-eabb1ca3-aedc-4e6f-87ee-132bad9efec4 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:52.175371 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-eabb1ca3-aedc-4e6f-87ee-132bad9efec4 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:52.389252 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-bda2979a-a352-42ed-bafc-ba2d77deeeb6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:52.408073 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-bda2979a-a352-42ed-bafc-ba2d77deeeb6 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b" status: 200 len: 1509 microversion: 2.1 time: 0.287686 Aug 31 13:01:52.409400 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 168/353] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:52 2022] GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b => generated 1509 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:52.434560 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-eabb1ca3-aedc-4e6f-87ee-132bad9efec4 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:52.443116 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-eabb1ca3-aedc-4e6f-87ee-132bad9efec4 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1260 microversion: 2.1 time: 0.292738 Aug 31 13:01:52.444863 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 186/354] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:52 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1260 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:53.430950 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-fcb92884-f27a-41cd-908d-89cfae8ea9a7 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:53.431547 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-fcb92884-f27a-41cd-908d-89cfae8ea9a7 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: f97b98c1-e7be-4c90-8c65-715135db482b] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:53.438098 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fcb92884-f27a-41cd-908d-89cfae8ea9a7 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:53.438620 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fcb92884-f27a-41cd-908d-89cfae8ea9a7 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:53.439043 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fcb92884-f27a-41cd-908d-89cfae8ea9a7 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:53.439724 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fcb92884-f27a-41cd-908d-89cfae8ea9a7 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:53.440193 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fcb92884-f27a-41cd-908d-89cfae8ea9a7 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:53.440633 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fcb92884-f27a-41cd-908d-89cfae8ea9a7 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:53.467511 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-5f38a046-4c05-4f9b-a573-b7c531ae350c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:53.468689 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-5f38a046-4c05-4f9b-a573-b7c531ae350c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:53.476264 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5f38a046-4c05-4f9b-a573-b7c531ae350c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:53.476968 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5f38a046-4c05-4f9b-a573-b7c531ae350c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:53.477546 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5f38a046-4c05-4f9b-a573-b7c531ae350c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:53.478387 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5f38a046-4c05-4f9b-a573-b7c531ae350c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:53.478980 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5f38a046-4c05-4f9b-a573-b7c531ae350c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:53.479654 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5f38a046-4c05-4f9b-a573-b7c531ae350c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:53.701017 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-5f38a046-4c05-4f9b-a573-b7c531ae350c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:53.706911 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-fcb92884-f27a-41cd-908d-89cfae8ea9a7 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:53.710012 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-5f38a046-4c05-4f9b-a573-b7c531ae350c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1260 microversion: 2.1 time: 0.249332 Aug 31 13:01:53.710837 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 187/355] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:53 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1260 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:01:53.730095 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-fcb92884-f27a-41cd-908d-89cfae8ea9a7 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b" status: 200 len: 1509 microversion: 2.1 time: 0.303174 Aug 31 13:01:53.745252 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 169/356] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:53 2022] GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b => generated 1509 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:54.734755 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-65e289e3-d1f0-42d7-b299-770b7440be89 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:54.735347 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-65e289e3-d1f0-42d7-b299-770b7440be89 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:54.742145 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-65e289e3-d1f0-42d7-b299-770b7440be89 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:54.742576 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-65e289e3-d1f0-42d7-b299-770b7440be89 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:54.743187 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-65e289e3-d1f0-42d7-b299-770b7440be89 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:54.744042 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-65e289e3-d1f0-42d7-b299-770b7440be89 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:54.744625 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-65e289e3-d1f0-42d7-b299-770b7440be89 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:54.745203 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-65e289e3-d1f0-42d7-b299-770b7440be89 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:54.754279 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-8b04c3bf-968f-4151-ba38-faffcfbf5127 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:54.755012 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-8b04c3bf-968f-4151-ba38-faffcfbf5127 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: f97b98c1-e7be-4c90-8c65-715135db482b] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:54.764527 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8b04c3bf-968f-4151-ba38-faffcfbf5127 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:54.765012 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8b04c3bf-968f-4151-ba38-faffcfbf5127 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:54.765585 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8b04c3bf-968f-4151-ba38-faffcfbf5127 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:54.766707 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8b04c3bf-968f-4151-ba38-faffcfbf5127 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:54.766867 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell1:SELECT=100 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:01:54.767514 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8b04c3bf-968f-4151-ba38-faffcfbf5127 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:54.768233 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8b04c3bf-968f-4151-ba38-faffcfbf5127 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:54.982897 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-65e289e3-d1f0-42d7-b299-770b7440be89 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:54.987960 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-8b04c3bf-968f-4151-ba38-faffcfbf5127 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:55.006080 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-65e289e3-d1f0-42d7-b299-770b7440be89 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1443 microversion: 2.1 time: 0.274607 Aug 31 13:01:55.007284 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 188/357] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:54 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1443 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:55.025779 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-8b04c3bf-968f-4151-ba38-faffcfbf5127 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b" status: 200 len: 1515 microversion: 2.1 time: 0.276705 Aug 31 13:01:55.026486 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 170/358] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:54 2022] GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b => generated 1515 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:55.032099 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-20dce066-45a6-426f-bd16-c1b27b53de0c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:55.032099 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-20dce066-45a6-426f-bd16-c1b27b53de0c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:55.040036 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-20dce066-45a6-426f-bd16-c1b27b53de0c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:55.040036 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-20dce066-45a6-426f-bd16-c1b27b53de0c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:55.040036 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-20dce066-45a6-426f-bd16-c1b27b53de0c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:55.040326 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-20dce066-45a6-426f-bd16-c1b27b53de0c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:55.041118 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-20dce066-45a6-426f-bd16-c1b27b53de0c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:55.041692 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-20dce066-45a6-426f-bd16-c1b27b53de0c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:55.252544 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-20dce066-45a6-426f-bd16-c1b27b53de0c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:55.263337 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-20dce066-45a6-426f-bd16-c1b27b53de0c tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1443 microversion: 2.1 time: 0.238791 Aug 31 13:01:55.265007 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 189/359] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:55 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1443 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:01:57.606951 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e1ed9308-d4f5-4c34-9f39-335b2abfcba0 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Action: 'create', calling method: .version_select at 0x7f19515c0a60>, body: {"keypair": {"name": "tempest-keypair-595504711", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL++pH/61AdAFgivPnvDOOAuGYlRWTx1oOIDBrerk73ECknbJm3HoMe6BcFEJHnQ+GjckxCJTk/ukOaB86UY26OHVZaNbcx/Q03PHns035osjPAD4jQGac6RhSRX3OsD8g=="}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:01:57.623591 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-e1ed9308-d4f5-4c34-9f39-335b2abfcba0 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Getting quotas for project b5b2950890c04cff868553069d6aba9a. Resources: {'key_pairs'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 13:01:57.627825 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-e1ed9308-d4f5-4c34-9f39-335b2abfcba0 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Getting quotas for user 32770594db4f437a958fd8c2c145a865 and project b5b2950890c04cff868553069d6aba9a. Resources: {'key_pairs'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 13:01:57.653096 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e1ed9308-d4f5-4c34-9f39-335b2abfcba0 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.058028 Aug 31 13:01:57.654015 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 171/360] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 31 13:01:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:01:58.018960 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-0e302393-6723-4086-89ec-c4f0dc8fb522 req-38123678-a71a-4a84-87fc-fcfd23f90a26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e792077-8a21-48f8-8f65-ce1a4aae8c0a", "tag": "22506bf3-0225-4ad3-b8d6-55645f334201"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:01:58.038769 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-0e302393-6723-4086-89ec-c4f0dc8fb522 req-38123678-a71a-4a84-87fc-fcfd23f90a26 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:58.040462 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-0e302393-6723-4086-89ec-c4f0dc8fb522 req-38123678-a71a-4a84-87fc-fcfd23f90a26 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:58.044152 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-0e302393-6723-4086-89ec-c4f0dc8fb522 req-38123678-a71a-4a84-87fc-fcfd23f90a26 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:58.071677 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-0e302393-6723-4086-89ec-c4f0dc8fb522 req-38123678-a71a-4a84-87fc-fcfd23f90a26 service nova] Creating event network-changed:22506bf3-0225-4ad3-b8d6-55645f334201 for instance 9e792077-8a21-48f8-8f65-ce1a4aae8c0a on hv-cinder-85442 Aug 31 13:01:58.082458 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-0e302393-6723-4086-89ec-c4f0dc8fb522 req-38123678-a71a-4a84-87fc-fcfd23f90a26 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066418 Aug 31 13:01:58.083492 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 190/361] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:01:58.119035 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-ae9dec63-efa8-4d8c-b824-3880cc524717 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-537989429", "imageRef": "2aa55919-0f25-4e84-a2e1-f60acbe208b2", "flavorRef": "452"}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:01:58.187320 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.network.neutron [None req-ae9dec63-efa8-4d8c-b824-3880cc524717 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] validate_networks() for None {{(pid=120705) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 13:01:58.979762 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-ae9dec63-efa8-4d8c-b824-3880cc524717 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Flavor limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 13:01:58.980461 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-ae9dec63-efa8-4d8c-b824-3880cc524717 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Image limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 13:01:58.981023 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-ae9dec63-efa8-4d8c-b824-3880cc524717 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Flavor pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 13:01:58.981472 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-ae9dec63-efa8-4d8c-b824-3880cc524717 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Image pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 13:01:58.981950 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-ae9dec63-efa8-4d8c-b824-3880cc524717 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 13:01:58.999461 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ae9dec63-efa8-4d8c-b824-3880cc524717 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:59.004366 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ae9dec63-efa8-4d8c-b824-3880cc524717 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:59.005111 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ae9dec63-efa8-4d8c-b824-3880cc524717 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:59.006278 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ae9dec63-efa8-4d8c-b824-3880cc524717 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:01:59.006995 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ae9dec63-efa8-4d8c-b824-3880cc524717 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:01:59.007633 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ae9dec63-efa8-4d8c-b824-3880cc524717 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:01:59.051910 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-ae9dec63-efa8-4d8c-b824-3880cc524717 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Getting quotas for project bd5880785dc2475c8268bfd75bc4e675. Resources: {'instances', 'ram', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 13:01:59.063704 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-ae9dec63-efa8-4d8c-b824-3880cc524717 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Getting quotas for user 28593deb5eb34bb0b7b2591e85f8f72d and project bd5880785dc2475c8268bfd75bc4e675. Resources: {'instances', 'ram', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 13:01:59.081404 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-ae9dec63-efa8-4d8c-b824-3880cc524717 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Going to run 1 instances... {{(pid=120705) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 13:01:59.084324 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-ae9dec63-efa8-4d8c-b824-3880cc524717 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] [instance: f852a7a7-53cc-4042-8cbe-5b62c0d374a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2aa55919-0f25-4e84-a2e1-f60acbe208b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120705) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 13:01:59.190102 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-ae9dec63-efa8-4d8c-b824-3880cc524717 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.073480 Aug 31 13:01:59.193174 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 172/362] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 31 13:01:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1079 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 13:01:59.206140 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-8ee25ae8-6ee7-4041-9e15-548d43fb535b tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:01:59.207758 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-8ee25ae8-6ee7-4041-9e15-548d43fb535b tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] [instance: f852a7a7-53cc-4042-8cbe-5b62c0d374a8] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:01:59.331238 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-8ee25ae8-6ee7-4041-9e15-548d43fb535b tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28593deb5eb34bb0b7b2591e85f8f72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5880785dc2475c8268bfd75bc4e675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:01:59.339424 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-8ee25ae8-6ee7-4041-9e15-548d43fb535b tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] 10.222.0.58 "GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8" status: 200 len: 1214 microversion: 2.1 time: 0.139735 Aug 31 13:01:59.339727 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 191/363] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:01:59 2022] GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8 => generated 1214 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:01:59.641163 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-69c534c6-6ef2-41b0-b7a3-ac3de1abeedc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1563888532", "imageRef": "2aa55919-0f25-4e84-a2e1-f60acbe208b2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "74e15830-8545-4f59-8ae1-57a628ad41c6"}], "security_groups": [{"name": "tempest-securitygroup--602728379"}], "key_name": "tempest-keypair-595504711", "user_data": "}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:01:59.767605 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.network.neutron [None req-69c534c6-6ef2-41b0-b7a3-ac3de1abeedc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] validate_networks() for [('74e15830-8545-4f59-8ae1-57a628ad41c6', None, None, None, None, None)] {{(pid=120705) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 13:01:59.879017 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-9005c4cc-4bd5-47e2-9057-aeb8a58ce13d tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1434058193", "imageRef": "2aa55919-0f25-4e84-a2e1-f60acbe208b2", "flavorRef": "452", "networks": [{"uuid": "54e74ead-7f1c-470c-84e5-efe0b2dc10c2"}]}} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:01:59.967044 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.network.neutron [None req-9005c4cc-4bd5-47e2-9057-aeb8a58ce13d tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] validate_networks() for [('54e74ead-7f1c-470c-84e5-efe0b2dc10c2', None, None, None, None, None)] {{(pid=120704) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 13:02:00.410235 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-69c534c6-6ef2-41b0-b7a3-ac3de1abeedc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Flavor limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 13:02:00.410785 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-69c534c6-6ef2-41b0-b7a3-ac3de1abeedc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Image limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 13:02:00.411721 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-69c534c6-6ef2-41b0-b7a3-ac3de1abeedc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Flavor pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 13:02:00.412306 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-69c534c6-6ef2-41b0-b7a3-ac3de1abeedc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Image pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 13:02:00.413102 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-69c534c6-6ef2-41b0-b7a3-ac3de1abeedc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 13:02:00.422588 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-69c534c6-6ef2-41b0-b7a3-ac3de1abeedc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:00.423056 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-69c534c6-6ef2-41b0-b7a3-ac3de1abeedc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:00.423462 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-69c534c6-6ef2-41b0-b7a3-ac3de1abeedc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:00.424217 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-69c534c6-6ef2-41b0-b7a3-ac3de1abeedc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:00.424660 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-69c534c6-6ef2-41b0-b7a3-ac3de1abeedc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:00.425065 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-69c534c6-6ef2-41b0-b7a3-ac3de1abeedc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:00.442814 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-69c534c6-6ef2-41b0-b7a3-ac3de1abeedc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Getting quotas for project b5b2950890c04cff868553069d6aba9a. Resources: {'instances', 'ram', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 13:02:00.446994 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-69c534c6-6ef2-41b0-b7a3-ac3de1abeedc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Getting quotas for user 32770594db4f437a958fd8c2c145a865 and project b5b2950890c04cff868553069d6aba9a. Resources: {'instances', 'ram', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 13:02:00.457783 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-69c534c6-6ef2-41b0-b7a3-ac3de1abeedc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Going to run 1 instances... {{(pid=120705) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 13:02:00.460043 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-69c534c6-6ef2-41b0-b7a3-ac3de1abeedc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2aa55919-0f25-4e84-a2e1-f60acbe208b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120705) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 13:02:00.507319 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-69c534c6-6ef2-41b0-b7a3-ac3de1abeedc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.871464 Aug 31 13:02:00.513972 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 173/364] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 31 13:01:59 2022] POST /compute/v2.1/servers => generated 408 bytes in 873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 13:02:00.513972 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-867ed81c-d01d-4ad6-9c63-a7925873e4c8 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:00.513972 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-867ed81c-d01d-4ad6-9c63-a7925873e4c8 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] [instance: f852a7a7-53cc-4042-8cbe-5b62c0d374a8] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:00.517092 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.virt.hardware [None req-9005c4cc-4bd5-47e2-9057-aeb8a58ce13d tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Flavor limits 0:0:0 {{(pid=120704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 13:02:00.517587 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.virt.hardware [None req-9005c4cc-4bd5-47e2-9057-aeb8a58ce13d tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Image limits 0:0:0 {{(pid=120704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 13:02:00.517968 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.virt.hardware [None req-9005c4cc-4bd5-47e2-9057-aeb8a58ce13d tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Flavor pref 0:0:0 {{(pid=120704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 13:02:00.518403 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.virt.hardware [None req-9005c4cc-4bd5-47e2-9057-aeb8a58ce13d tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Image pref 0:0:0 {{(pid=120704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 13:02:00.518816 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.virt.hardware [None req-9005c4cc-4bd5-47e2-9057-aeb8a58ce13d tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 13:02:00.520285 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-867ed81c-d01d-4ad6-9c63-a7925873e4c8 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:00.520757 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-867ed81c-d01d-4ad6-9c63-a7925873e4c8 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:00.521177 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-867ed81c-d01d-4ad6-9c63-a7925873e4c8 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:00.521861 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-867ed81c-d01d-4ad6-9c63-a7925873e4c8 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:00.522380 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-867ed81c-d01d-4ad6-9c63-a7925873e4c8 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:00.522786 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-867ed81c-d01d-4ad6-9c63-a7925873e4c8 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:00.539407 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9005c4cc-4bd5-47e2-9057-aeb8a58ce13d tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:00.539949 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9005c4cc-4bd5-47e2-9057-aeb8a58ce13d tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:00.540465 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9005c4cc-4bd5-47e2-9057-aeb8a58ce13d tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:00.541094 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9005c4cc-4bd5-47e2-9057-aeb8a58ce13d tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:00.541524 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9005c4cc-4bd5-47e2-9057-aeb8a58ce13d tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:00.542142 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9005c4cc-4bd5-47e2-9057-aeb8a58ce13d tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:00.560631 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.quota [None req-9005c4cc-4bd5-47e2-9057-aeb8a58ce13d tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Getting quotas for project 7c401f76027848f0980f470af73e4473. Resources: {'instances', 'ram', 'cores'} {{(pid=120704) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 13:02:00.565888 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.quota [None req-9005c4cc-4bd5-47e2-9057-aeb8a58ce13d tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Getting quotas for user bf155bc9925646f59e92f597782a8881 and project 7c401f76027848f0980f470af73e4473. Resources: {'instances', 'ram', 'cores'} {{(pid=120704) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 13:02:00.579663 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-9005c4cc-4bd5-47e2-9057-aeb8a58ce13d tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Going to run 1 instances... {{(pid=120704) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 13:02:00.582044 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-9005c4cc-4bd5-47e2-9057-aeb8a58ce13d tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: a7538710-7904-40dc-afac-8d821d6331d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2aa55919-0f25-4e84-a2e1-f60acbe208b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120704) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 13:02:00.593687 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-867ed81c-d01d-4ad6-9c63-a7925873e4c8 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28593deb5eb34bb0b7b2591e85f8f72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5880785dc2475c8268bfd75bc4e675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:00.604268 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-867ed81c-d01d-4ad6-9c63-a7925873e4c8 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] 10.222.0.58 "GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8" status: 200 len: 1266 microversion: 2.1 time: 0.094765 Aug 31 13:02:00.610247 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 174/365] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:00 2022] GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8 => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:00.610247 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-560f02b5-951e-4001-80fa-01e3b5a49568 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:00.610247 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-560f02b5-951e-4001-80fa-01e3b5a49568 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:00.650593 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-9005c4cc-4bd5-47e2-9057-aeb8a58ce13d tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.775737 Aug 31 13:02:00.652208 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 192/366] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 31 13:01:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 13:02:00.665482 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-edb47f22-589b-49fb-832a-9cfe0ab39744 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:00.666297 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-edb47f22-589b-49fb-832a-9cfe0ab39744 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: a7538710-7904-40dc-afac-8d821d6331d5] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:00.702287 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-560f02b5-951e-4001-80fa-01e3b5a49568 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:00.710947 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-560f02b5-951e-4001-80fa-01e3b5a49568 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1245 microversion: 2.1 time: 0.104795 Aug 31 13:02:00.711527 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 175/367] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:00 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1245 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:00.769264 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-edb47f22-589b-49fb-832a-9cfe0ab39744 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf155bc9925646f59e92f597782a8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c401f76027848f0980f470af73e4473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:00.777049 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-edb47f22-589b-49fb-832a-9cfe0ab39744 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5" status: 200 len: 1219 microversion: 2.1 time: 0.118340 Aug 31 13:02:00.778202 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 193/368] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:00 2022] GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5 => generated 1219 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:02:01.630526 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-c3327f9d-3dd7-4086-8716-707fedf78c8a tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:01.632087 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-c3327f9d-3dd7-4086-8716-707fedf78c8a tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] [instance: f852a7a7-53cc-4042-8cbe-5b62c0d374a8] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:01.640799 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c3327f9d-3dd7-4086-8716-707fedf78c8a tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:01.641774 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c3327f9d-3dd7-4086-8716-707fedf78c8a tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:01.642552 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c3327f9d-3dd7-4086-8716-707fedf78c8a tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:01.643293 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c3327f9d-3dd7-4086-8716-707fedf78c8a tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:01.643978 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c3327f9d-3dd7-4086-8716-707fedf78c8a tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:01.644718 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c3327f9d-3dd7-4086-8716-707fedf78c8a tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:01.731934 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-977b151f-da7e-474a-944c-6093935c9458 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:01.732579 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-977b151f-da7e-474a-944c-6093935c9458 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:01.757347 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-977b151f-da7e-474a-944c-6093935c9458 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:01.758399 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-977b151f-da7e-474a-944c-6093935c9458 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:01.759068 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-977b151f-da7e-474a-944c-6093935c9458 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:01.760057 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-977b151f-da7e-474a-944c-6093935c9458 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:01.760727 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-977b151f-da7e-474a-944c-6093935c9458 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:01.761362 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-977b151f-da7e-474a-944c-6093935c9458 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:01.906119 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-977b151f-da7e-474a-944c-6093935c9458 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:01.917376 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-977b151f-da7e-474a-944c-6093935c9458 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1297 microversion: 2.1 time: 0.190574 Aug 31 13:02:01.939840 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 194/369] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:01 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1297 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:01.940305 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-c3327f9d-3dd7-4086-8716-707fedf78c8a tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28593deb5eb34bb0b7b2591e85f8f72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5880785dc2475c8268bfd75bc4e675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:01.948816 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-3d87c9e7-97b0-4f32-a915-1bb514a6b4c3 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:01.952558 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-3d87c9e7-97b0-4f32-a915-1bb514a6b4c3 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: a7538710-7904-40dc-afac-8d821d6331d5] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:01.952843 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-c3327f9d-3dd7-4086-8716-707fedf78c8a tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] 10.222.0.58 "GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8" status: 200 len: 1314 microversion: 2.1 time: 0.327789 Aug 31 13:02:01.953477 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 176/370] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:01 2022] GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8 => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:01.966204 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3d87c9e7-97b0-4f32-a915-1bb514a6b4c3 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:01.966204 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3d87c9e7-97b0-4f32-a915-1bb514a6b4c3 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:01.966204 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3d87c9e7-97b0-4f32-a915-1bb514a6b4c3 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:01.968673 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3d87c9e7-97b0-4f32-a915-1bb514a6b4c3 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:01.969389 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3d87c9e7-97b0-4f32-a915-1bb514a6b4c3 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:01.970202 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3d87c9e7-97b0-4f32-a915-1bb514a6b4c3 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:02.089014 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-3d87c9e7-97b0-4f32-a915-1bb514a6b4c3 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf155bc9925646f59e92f597782a8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c401f76027848f0980f470af73e4473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:02.097393 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-3d87c9e7-97b0-4f32-a915-1bb514a6b4c3 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5" status: 200 len: 1271 microversion: 2.1 time: 0.166814 Aug 31 13:02:02.098001 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 195/371] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:01 2022] GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5 => generated 1271 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:02.605245 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-cac6ee4a-2587-40c7-b10b-272541d72303 req-ebab5286-e55e-43fb-b69c-acd3882ee6f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f852a7a7-53cc-4042-8cbe-5b62c0d374a8", "tag": "4ccd8af6-a4d1-4200-bdd5-e7d2aec7f3ca"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:02:02.616932 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-cac6ee4a-2587-40c7-b10b-272541d72303 req-ebab5286-e55e-43fb-b69c-acd3882ee6f7 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:02.617491 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-cac6ee4a-2587-40c7-b10b-272541d72303 req-ebab5286-e55e-43fb-b69c-acd3882ee6f7 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:02.618101 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-cac6ee4a-2587-40c7-b10b-272541d72303 req-ebab5286-e55e-43fb-b69c-acd3882ee6f7 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:02.634166 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-cac6ee4a-2587-40c7-b10b-272541d72303 req-ebab5286-e55e-43fb-b69c-acd3882ee6f7 service nova] Creating event network-changed:4ccd8af6-a4d1-4200-bdd5-e7d2aec7f3ca for instance f852a7a7-53cc-4042-8cbe-5b62c0d374a8 on hv-cinder-85442 Aug 31 13:02:02.640860 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-cac6ee4a-2587-40c7-b10b-272541d72303 req-ebab5286-e55e-43fb-b69c-acd3882ee6f7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039672 Aug 31 13:02:02.641858 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 177/372] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:02:02.953542 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-bed8fd3b-6816-43ba-a772-ab9d6e929ecc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:02.954859 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-bed8fd3b-6816-43ba-a772-ab9d6e929ecc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:02.958915 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:02:02.963112 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bed8fd3b-6816-43ba-a772-ab9d6e929ecc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:02.963618 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bed8fd3b-6816-43ba-a772-ab9d6e929ecc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:02.964142 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bed8fd3b-6816-43ba-a772-ab9d6e929ecc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:02.970023 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bed8fd3b-6816-43ba-a772-ab9d6e929ecc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:02.971576 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bed8fd3b-6816-43ba-a772-ab9d6e929ecc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:02.972812 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bed8fd3b-6816-43ba-a772-ab9d6e929ecc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:02.979378 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-503885f2-6fe1-49e2-9927-afa3df9dbb7f tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:02.980149 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-503885f2-6fe1-49e2-9927-afa3df9dbb7f tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] [instance: f852a7a7-53cc-4042-8cbe-5b62c0d374a8] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:02.988759 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-503885f2-6fe1-49e2-9927-afa3df9dbb7f tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:02.989249 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-503885f2-6fe1-49e2-9927-afa3df9dbb7f tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:02.989941 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-503885f2-6fe1-49e2-9927-afa3df9dbb7f tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:02.990648 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-503885f2-6fe1-49e2-9927-afa3df9dbb7f tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:02.991129 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-503885f2-6fe1-49e2-9927-afa3df9dbb7f tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:02.991548 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-503885f2-6fe1-49e2-9927-afa3df9dbb7f tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:03.083473 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-bed8fd3b-6816-43ba-a772-ab9d6e929ecc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:03.095395 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-bed8fd3b-6816-43ba-a772-ab9d6e929ecc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1303 microversion: 2.1 time: 0.146231 Aug 31 13:02:03.110118 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 196/373] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:02 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1303 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:03.118294 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-5c22b292-7731-4d1c-a97e-0bf8ad1f3029 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:03.119177 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-5c22b292-7731-4d1c-a97e-0bf8ad1f3029 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: a7538710-7904-40dc-afac-8d821d6331d5] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:03.125784 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5c22b292-7731-4d1c-a97e-0bf8ad1f3029 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:03.126719 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5c22b292-7731-4d1c-a97e-0bf8ad1f3029 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:03.127428 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5c22b292-7731-4d1c-a97e-0bf8ad1f3029 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:03.128376 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5c22b292-7731-4d1c-a97e-0bf8ad1f3029 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:03.129045 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5c22b292-7731-4d1c-a97e-0bf8ad1f3029 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:03.129663 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5c22b292-7731-4d1c-a97e-0bf8ad1f3029 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:03.231145 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-5c22b292-7731-4d1c-a97e-0bf8ad1f3029 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf155bc9925646f59e92f597782a8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c401f76027848f0980f470af73e4473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:03.241838 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-5c22b292-7731-4d1c-a97e-0bf8ad1f3029 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5" status: 200 len: 1277 microversion: 2.1 time: 0.127354 Aug 31 13:02:03.243758 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 197/374] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:03 2022] GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5 => generated 1277 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:03.295571 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-503885f2-6fe1-49e2-9927-afa3df9dbb7f tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28593deb5eb34bb0b7b2591e85f8f72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5880785dc2475c8268bfd75bc4e675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:03.304665 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-503885f2-6fe1-49e2-9927-afa3df9dbb7f tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] 10.222.0.58 "GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8" status: 200 len: 1314 microversion: 2.1 time: 0.330845 Aug 31 13:02:03.305730 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 178/375] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:02 2022] GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8 => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:04.117112 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-6f3ae655-1b1a-4b6a-bc14-a3865bbb8e09 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:04.117743 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-6f3ae655-1b1a-4b6a-bc14-a3865bbb8e09 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:04.124487 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6f3ae655-1b1a-4b6a-bc14-a3865bbb8e09 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:04.124971 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6f3ae655-1b1a-4b6a-bc14-a3865bbb8e09 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:04.125405 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6f3ae655-1b1a-4b6a-bc14-a3865bbb8e09 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:04.126128 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6f3ae655-1b1a-4b6a-bc14-a3865bbb8e09 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:04.126598 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6f3ae655-1b1a-4b6a-bc14-a3865bbb8e09 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:04.127005 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6f3ae655-1b1a-4b6a-bc14-a3865bbb8e09 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:04.262754 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-6dacbde3-0650-4a70-9e4b-e154769c9e2d tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:04.263309 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-6dacbde3-0650-4a70-9e4b-e154769c9e2d tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: a7538710-7904-40dc-afac-8d821d6331d5] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:04.269895 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6dacbde3-0650-4a70-9e4b-e154769c9e2d tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:04.270379 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6dacbde3-0650-4a70-9e4b-e154769c9e2d tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:04.270814 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6dacbde3-0650-4a70-9e4b-e154769c9e2d tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:04.271504 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6dacbde3-0650-4a70-9e4b-e154769c9e2d tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:04.272002 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6dacbde3-0650-4a70-9e4b-e154769c9e2d tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:04.272461 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6dacbde3-0650-4a70-9e4b-e154769c9e2d tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:04.351831 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-6f3ae655-1b1a-4b6a-bc14-a3865bbb8e09 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:04.360444 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-6f3ae655-1b1a-4b6a-bc14-a3865bbb8e09 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1370 microversion: 2.1 time: 0.247448 Aug 31 13:02:04.361057 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 198/376] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:04 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1370 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:04.365559 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-fed9e4c8-8f36-449a-825f-bf1896c74f99 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:04.366269 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-fed9e4c8-8f36-449a-825f-bf1896c74f99 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] [instance: f852a7a7-53cc-4042-8cbe-5b62c0d374a8] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:04.372447 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fed9e4c8-8f36-449a-825f-bf1896c74f99 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:04.372931 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fed9e4c8-8f36-449a-825f-bf1896c74f99 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:04.373362 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fed9e4c8-8f36-449a-825f-bf1896c74f99 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:04.374057 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fed9e4c8-8f36-449a-825f-bf1896c74f99 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:04.374524 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fed9e4c8-8f36-449a-825f-bf1896c74f99 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:04.374947 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fed9e4c8-8f36-449a-825f-bf1896c74f99 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:04.532147 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-6dacbde3-0650-4a70-9e4b-e154769c9e2d tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf155bc9925646f59e92f597782a8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c401f76027848f0980f470af73e4473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:04.544106 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-6dacbde3-0650-4a70-9e4b-e154769c9e2d tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5" status: 200 len: 1319 microversion: 2.1 time: 0.284963 Aug 31 13:02:04.544808 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 179/377] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:04 2022] GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5 => generated 1319 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:04.877667 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-fed9e4c8-8f36-449a-825f-bf1896c74f99 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28593deb5eb34bb0b7b2591e85f8f72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5880785dc2475c8268bfd75bc4e675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:04.886054 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-fed9e4c8-8f36-449a-825f-bf1896c74f99 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] 10.222.0.58 "GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8" status: 200 len: 1314 microversion: 2.1 time: 0.524018 Aug 31 13:02:04.886691 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 199/378] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:04 2022] GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8 => generated 1314 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:04.991472 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-d57a11a9-5b84-4ad2-9fff-16a1d7e7a87a req-fc353c87-d7af-41fb-902f-4c8641cb1297 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec", "tag": "d45b253a-763d-4df7-b467-4cfc91042795"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:02:05.002053 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-d57a11a9-5b84-4ad2-9fff-16a1d7e7a87a req-fc353c87-d7af-41fb-902f-4c8641cb1297 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:05.002520 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-d57a11a9-5b84-4ad2-9fff-16a1d7e7a87a req-fc353c87-d7af-41fb-902f-4c8641cb1297 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:05.002949 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-d57a11a9-5b84-4ad2-9fff-16a1d7e7a87a req-fc353c87-d7af-41fb-902f-4c8641cb1297 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:05.013914 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-d57a11a9-5b84-4ad2-9fff-16a1d7e7a87a req-fc353c87-d7af-41fb-902f-4c8641cb1297 service nova] Creating event network-changed:d45b253a-763d-4df7-b467-4cfc91042795 for instance dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec on hv-cinder-85442 Aug 31 13:02:05.019261 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-d57a11a9-5b84-4ad2-9fff-16a1d7e7a87a req-fc353c87-d7af-41fb-902f-4c8641cb1297 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031567 Aug 31 13:02:05.020179 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 180/379] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:02:05.384319 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-ae46320a-051b-4adc-9d50-6f34bba06ad1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:05.385078 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-ae46320a-051b-4adc-9d50-6f34bba06ad1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:05.394088 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ae46320a-051b-4adc-9d50-6f34bba06ad1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:05.394684 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ae46320a-051b-4adc-9d50-6f34bba06ad1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:05.395246 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ae46320a-051b-4adc-9d50-6f34bba06ad1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:05.396205 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ae46320a-051b-4adc-9d50-6f34bba06ad1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:05.396795 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ae46320a-051b-4adc-9d50-6f34bba06ad1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:05.397356 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ae46320a-051b-4adc-9d50-6f34bba06ad1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:05.541609 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-ae46320a-051b-4adc-9d50-6f34bba06ad1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:05.550326 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-ae46320a-051b-4adc-9d50-6f34bba06ad1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1370 microversion: 2.1 time: 0.172138 Aug 31 13:02:05.550898 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 200/380] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:05 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:05.571226 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e2639aa1-a53b-4a2e-ae5e-8573a8fdf0f2 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:05.572035 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e2639aa1-a53b-4a2e-ae5e-8573a8fdf0f2 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: a7538710-7904-40dc-afac-8d821d6331d5] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:05.578539 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e2639aa1-a53b-4a2e-ae5e-8573a8fdf0f2 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:05.579031 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e2639aa1-a53b-4a2e-ae5e-8573a8fdf0f2 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:05.579435 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e2639aa1-a53b-4a2e-ae5e-8573a8fdf0f2 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:05.580227 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e2639aa1-a53b-4a2e-ae5e-8573a8fdf0f2 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:05.580587 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e2639aa1-a53b-4a2e-ae5e-8573a8fdf0f2 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:05.581037 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e2639aa1-a53b-4a2e-ae5e-8573a8fdf0f2 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:05.722344 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e2639aa1-a53b-4a2e-ae5e-8573a8fdf0f2 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf155bc9925646f59e92f597782a8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c401f76027848f0980f470af73e4473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:05.730400 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e2639aa1-a53b-4a2e-ae5e-8573a8fdf0f2 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5" status: 200 len: 1319 microversion: 2.1 time: 0.163612 Aug 31 13:02:05.730973 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 181/381] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:05 2022] GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:05.909396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-8b013735-4788-4d25-8a09-e0445af84468 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:05.910083 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-8b013735-4788-4d25-8a09-e0445af84468 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] [instance: f852a7a7-53cc-4042-8cbe-5b62c0d374a8] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:05.917471 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8b013735-4788-4d25-8a09-e0445af84468 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:05.917951 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8b013735-4788-4d25-8a09-e0445af84468 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:05.918396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8b013735-4788-4d25-8a09-e0445af84468 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:05.919086 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8b013735-4788-4d25-8a09-e0445af84468 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:05.919555 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8b013735-4788-4d25-8a09-e0445af84468 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:05.920021 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8b013735-4788-4d25-8a09-e0445af84468 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:06.079845 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-8b013735-4788-4d25-8a09-e0445af84468 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28593deb5eb34bb0b7b2591e85f8f72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5880785dc2475c8268bfd75bc4e675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:06.087586 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-8b013735-4788-4d25-8a09-e0445af84468 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] 10.222.0.58 "GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8" status: 200 len: 1314 microversion: 2.1 time: 0.183618 Aug 31 13:02:06.088262 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 201/382] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:05 2022] GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:06.571748 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-eb6eaae7-4ff7-4f67-8886-78d98aaa18fd tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:06.572352 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-eb6eaae7-4ff7-4f67-8886-78d98aaa18fd tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:06.578984 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-eb6eaae7-4ff7-4f67-8886-78d98aaa18fd tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:06.579465 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-eb6eaae7-4ff7-4f67-8886-78d98aaa18fd tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:06.579928 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-eb6eaae7-4ff7-4f67-8886-78d98aaa18fd tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:06.580610 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-eb6eaae7-4ff7-4f67-8886-78d98aaa18fd tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:06.581060 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-eb6eaae7-4ff7-4f67-8886-78d98aaa18fd tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:06.581479 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-eb6eaae7-4ff7-4f67-8886-78d98aaa18fd tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:06.720903 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-eb6eaae7-4ff7-4f67-8886-78d98aaa18fd tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:06.723269 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:02:06.730556 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-eb6eaae7-4ff7-4f67-8886-78d98aaa18fd tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1370 microversion: 2.1 time: 0.162895 Aug 31 13:02:06.731122 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 182/383] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:06 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:06.751556 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-341b83ed-87bc-4afe-a332-afa5b017596b tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:06.752169 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-341b83ed-87bc-4afe-a332-afa5b017596b tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: a7538710-7904-40dc-afac-8d821d6331d5] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:06.759441 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-341b83ed-87bc-4afe-a332-afa5b017596b tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:06.759938 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-341b83ed-87bc-4afe-a332-afa5b017596b tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:06.760394 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-341b83ed-87bc-4afe-a332-afa5b017596b tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:06.761085 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-341b83ed-87bc-4afe-a332-afa5b017596b tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:06.761535 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-341b83ed-87bc-4afe-a332-afa5b017596b tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:06.761958 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-341b83ed-87bc-4afe-a332-afa5b017596b tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:06.898356 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-341b83ed-87bc-4afe-a332-afa5b017596b tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf155bc9925646f59e92f597782a8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c401f76027848f0980f470af73e4473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:06.906200 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-341b83ed-87bc-4afe-a332-afa5b017596b tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5" status: 200 len: 1319 microversion: 2.1 time: 0.158606 Aug 31 13:02:06.906782 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 202/384] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:06 2022] GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:07.109313 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-5f2c01f4-f4e6-41bd-aa29-42059b8cb279 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:07.109824 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-5f2c01f4-f4e6-41bd-aa29-42059b8cb279 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] [instance: f852a7a7-53cc-4042-8cbe-5b62c0d374a8] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:07.117073 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5f2c01f4-f4e6-41bd-aa29-42059b8cb279 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:07.117604 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5f2c01f4-f4e6-41bd-aa29-42059b8cb279 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:07.118016 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5f2c01f4-f4e6-41bd-aa29-42059b8cb279 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:07.118797 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5f2c01f4-f4e6-41bd-aa29-42059b8cb279 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:07.119256 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5f2c01f4-f4e6-41bd-aa29-42059b8cb279 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:07.119679 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5f2c01f4-f4e6-41bd-aa29-42059b8cb279 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:07.294426 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-5f2c01f4-f4e6-41bd-aa29-42059b8cb279 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28593deb5eb34bb0b7b2591e85f8f72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5880785dc2475c8268bfd75bc4e675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:07.303434 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-5f2c01f4-f4e6-41bd-aa29-42059b8cb279 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] 10.222.0.58 "GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8" status: 200 len: 1314 microversion: 2.1 time: 0.198981 Aug 31 13:02:07.312225 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 183/385] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:07 2022] GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:07.750590 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-a123d7d5-670e-4b38-b235-0511cfb4493e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:07.751466 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-a123d7d5-670e-4b38-b235-0511cfb4493e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:07.763451 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a123d7d5-670e-4b38-b235-0511cfb4493e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:07.764723 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a123d7d5-670e-4b38-b235-0511cfb4493e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:07.765327 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a123d7d5-670e-4b38-b235-0511cfb4493e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:07.768690 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a123d7d5-670e-4b38-b235-0511cfb4493e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:07.769321 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a123d7d5-670e-4b38-b235-0511cfb4493e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:07.769960 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a123d7d5-670e-4b38-b235-0511cfb4493e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:07.928903 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-2e674ec3-5714-4d30-b009-a2a02a3b4b21 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:07.929522 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-2e674ec3-5714-4d30-b009-a2a02a3b4b21 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: a7538710-7904-40dc-afac-8d821d6331d5] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:07.936246 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2e674ec3-5714-4d30-b009-a2a02a3b4b21 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:07.936975 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2e674ec3-5714-4d30-b009-a2a02a3b4b21 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:07.937765 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2e674ec3-5714-4d30-b009-a2a02a3b4b21 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:07.938700 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2e674ec3-5714-4d30-b009-a2a02a3b4b21 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:07.939547 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2e674ec3-5714-4d30-b009-a2a02a3b4b21 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:07.940203 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2e674ec3-5714-4d30-b009-a2a02a3b4b21 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:08.265658 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-a123d7d5-670e-4b38-b235-0511cfb4493e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:08.279419 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-a123d7d5-670e-4b38-b235-0511cfb4493e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1370 microversion: 2.1 time: 0.532511 Aug 31 13:02:08.292474 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 203/386] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:07 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1370 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:08.325787 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-bfe29bc8-fb66-47f6-91c5-e4e6076b0ae4 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:08.326393 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-bfe29bc8-fb66-47f6-91c5-e4e6076b0ae4 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] [instance: f852a7a7-53cc-4042-8cbe-5b62c0d374a8] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:08.333240 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bfe29bc8-fb66-47f6-91c5-e4e6076b0ae4 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:08.333747 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bfe29bc8-fb66-47f6-91c5-e4e6076b0ae4 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:08.334172 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bfe29bc8-fb66-47f6-91c5-e4e6076b0ae4 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:08.335194 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bfe29bc8-fb66-47f6-91c5-e4e6076b0ae4 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:08.335701 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bfe29bc8-fb66-47f6-91c5-e4e6076b0ae4 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:08.336370 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bfe29bc8-fb66-47f6-91c5-e4e6076b0ae4 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:08.338411 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-2e674ec3-5714-4d30-b009-a2a02a3b4b21 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf155bc9925646f59e92f597782a8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c401f76027848f0980f470af73e4473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:08.348202 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-2e674ec3-5714-4d30-b009-a2a02a3b4b21 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5" status: 200 len: 1319 microversion: 2.1 time: 0.424617 Aug 31 13:02:08.362126 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 184/387] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:07 2022] GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5 => generated 1319 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:08.672561 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-bfe29bc8-fb66-47f6-91c5-e4e6076b0ae4 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28593deb5eb34bb0b7b2591e85f8f72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5880785dc2475c8268bfd75bc4e675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:08.681515 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-bfe29bc8-fb66-47f6-91c5-e4e6076b0ae4 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] 10.222.0.58 "GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8" status: 200 len: 1314 microversion: 2.1 time: 0.359797 Aug 31 13:02:08.682905 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 204/388] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:08 2022] GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8 => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:02:08.960828 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-a159e17f-0335-4444-bc10-63aa638d2456 req-50af623f-34a2-4362-8063-05e35ffaab50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7538710-7904-40dc-afac-8d821d6331d5", "tag": "9ea0da77-0025-427d-9a88-7cd21356e351"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:02:08.967396 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:02:08.975337 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-a159e17f-0335-4444-bc10-63aa638d2456 req-50af623f-34a2-4362-8063-05e35ffaab50 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:08.976231 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-a159e17f-0335-4444-bc10-63aa638d2456 req-50af623f-34a2-4362-8063-05e35ffaab50 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:08.976867 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-a159e17f-0335-4444-bc10-63aa638d2456 req-50af623f-34a2-4362-8063-05e35ffaab50 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:08.990700 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-a159e17f-0335-4444-bc10-63aa638d2456 req-50af623f-34a2-4362-8063-05e35ffaab50 service nova] Creating event network-changed:9ea0da77-0025-427d-9a88-7cd21356e351 for instance a7538710-7904-40dc-afac-8d821d6331d5 on hv-cinder-85442 Aug 31 13:02:08.996135 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-a159e17f-0335-4444-bc10-63aa638d2456 req-50af623f-34a2-4362-8063-05e35ffaab50 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039508 Aug 31 13:02:08.997471 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 185/389] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:02:09.301873 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-9deddd3c-bc9b-478c-b1a1-f418de57655d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:09.302475 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-9deddd3c-bc9b-478c-b1a1-f418de57655d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:09.309051 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9deddd3c-bc9b-478c-b1a1-f418de57655d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:09.309528 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9deddd3c-bc9b-478c-b1a1-f418de57655d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:09.309957 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9deddd3c-bc9b-478c-b1a1-f418de57655d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:09.310693 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9deddd3c-bc9b-478c-b1a1-f418de57655d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:09.311135 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9deddd3c-bc9b-478c-b1a1-f418de57655d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:09.311547 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9deddd3c-bc9b-478c-b1a1-f418de57655d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:09.370724 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-8634f1be-b1f2-4231-ad8e-f64f0ff57179 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:09.371505 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-8634f1be-b1f2-4231-ad8e-f64f0ff57179 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: a7538710-7904-40dc-afac-8d821d6331d5] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:09.378863 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8634f1be-b1f2-4231-ad8e-f64f0ff57179 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:09.379642 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8634f1be-b1f2-4231-ad8e-f64f0ff57179 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:09.380199 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8634f1be-b1f2-4231-ad8e-f64f0ff57179 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:09.380886 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8634f1be-b1f2-4231-ad8e-f64f0ff57179 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:09.381488 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8634f1be-b1f2-4231-ad8e-f64f0ff57179 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:09.382062 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8634f1be-b1f2-4231-ad8e-f64f0ff57179 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:09.494692 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-9deddd3c-bc9b-478c-b1a1-f418de57655d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:09.513430 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-9deddd3c-bc9b-478c-b1a1-f418de57655d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1370 microversion: 2.1 time: 0.215342 Aug 31 13:02:09.517308 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 205/390] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:09 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1370 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:09.564337 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-8634f1be-b1f2-4231-ad8e-f64f0ff57179 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf155bc9925646f59e92f597782a8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c401f76027848f0980f470af73e4473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:09.573602 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-8634f1be-b1f2-4231-ad8e-f64f0ff57179 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5" status: 200 len: 1319 microversion: 2.1 time: 0.207724 Aug 31 13:02:09.574457 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 186/391] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:09 2022] GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:02:09.702546 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-0090594a-8683-481c-b9b2-a2bf0a603d3d tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:09.703371 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-0090594a-8683-481c-b9b2-a2bf0a603d3d tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] [instance: f852a7a7-53cc-4042-8cbe-5b62c0d374a8] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:09.712181 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0090594a-8683-481c-b9b2-a2bf0a603d3d tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:09.713072 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0090594a-8683-481c-b9b2-a2bf0a603d3d tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:09.713778 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0090594a-8683-481c-b9b2-a2bf0a603d3d tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:09.714674 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0090594a-8683-481c-b9b2-a2bf0a603d3d tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:09.715321 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0090594a-8683-481c-b9b2-a2bf0a603d3d tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:09.715967 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0090594a-8683-481c-b9b2-a2bf0a603d3d tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:09.859364 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-0090594a-8683-481c-b9b2-a2bf0a603d3d tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28593deb5eb34bb0b7b2591e85f8f72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5880785dc2475c8268bfd75bc4e675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:09.884083 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-0090594a-8683-481c-b9b2-a2bf0a603d3d tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] 10.222.0.58 "GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8" status: 200 len: 1314 microversion: 2.1 time: 0.185579 Aug 31 13:02:09.884677 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 206/392] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:09 2022] GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:10.034234 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-52e77ce7-e6d9-4654-9387-b0e10a5c3074 req-a5d9e28c-db99-4272-91fa-77beee3b4340 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f852a7a7-53cc-4042-8cbe-5b62c0d374a8", "name": "network-vif-plugged", "status": "completed", "tag": "4ccd8af6-a4d1-4200-bdd5-e7d2aec7f3ca"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:02:10.045119 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-52e77ce7-e6d9-4654-9387-b0e10a5c3074 req-a5d9e28c-db99-4272-91fa-77beee3b4340 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:10.045770 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-52e77ce7-e6d9-4654-9387-b0e10a5c3074 req-a5d9e28c-db99-4272-91fa-77beee3b4340 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:10.046189 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-52e77ce7-e6d9-4654-9387-b0e10a5c3074 req-a5d9e28c-db99-4272-91fa-77beee3b4340 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:10.059984 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-52e77ce7-e6d9-4654-9387-b0e10a5c3074 req-a5d9e28c-db99-4272-91fa-77beee3b4340 service nova] Creating event network-vif-plugged:4ccd8af6-a4d1-4200-bdd5-e7d2aec7f3ca for instance f852a7a7-53cc-4042-8cbe-5b62c0d374a8 on hv-cinder-85442 Aug 31 13:02:10.072680 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-52e77ce7-e6d9-4654-9387-b0e10a5c3074 req-a5d9e28c-db99-4272-91fa-77beee3b4340 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042925 Aug 31 13:02:10.073442 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 187/393] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:02:10.540860 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-8099f705-e9d5-410d-86fa-c0949d50875d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:10.541525 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-8099f705-e9d5-410d-86fa-c0949d50875d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:10.549500 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8099f705-e9d5-410d-86fa-c0949d50875d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:10.550072 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8099f705-e9d5-410d-86fa-c0949d50875d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:10.550591 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8099f705-e9d5-410d-86fa-c0949d50875d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:10.551392 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8099f705-e9d5-410d-86fa-c0949d50875d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:10.552122 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8099f705-e9d5-410d-86fa-c0949d50875d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:10.552629 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8099f705-e9d5-410d-86fa-c0949d50875d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:10.553143 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell0:SELECT=2 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:02:10.591962 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=4 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:02:10.596733 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b67d6ba9-564d-4217-a93c-5bc07c4d810c tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:10.597426 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b67d6ba9-564d-4217-a93c-5bc07c4d810c tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: a7538710-7904-40dc-afac-8d821d6331d5] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:10.604916 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b67d6ba9-564d-4217-a93c-5bc07c4d810c tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:10.605388 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b67d6ba9-564d-4217-a93c-5bc07c4d810c tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:10.605903 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b67d6ba9-564d-4217-a93c-5bc07c4d810c tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:10.606544 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b67d6ba9-564d-4217-a93c-5bc07c4d810c tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:10.606901 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b67d6ba9-564d-4217-a93c-5bc07c4d810c tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:10.607302 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b67d6ba9-564d-4217-a93c-5bc07c4d810c tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:10.706940 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=18 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:02:10.757437 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-8099f705-e9d5-410d-86fa-c0949d50875d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:10.766642 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-8099f705-e9d5-410d-86fa-c0949d50875d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1370 microversion: 2.1 time: 0.231544 Aug 31 13:02:10.767229 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 207/394] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:10 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1370 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:10.791647 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-b67d6ba9-564d-4217-a93c-5bc07c4d810c tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf155bc9925646f59e92f597782a8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c401f76027848f0980f470af73e4473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:10.799756 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b67d6ba9-564d-4217-a93c-5bc07c4d810c tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5" status: 200 len: 1319 microversion: 2.1 time: 0.209227 Aug 31 13:02:10.800380 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 188/395] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:10 2022] GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:10.905143 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-1ed19fdb-8359-4fa9-9dba-142688066a90 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:10.905774 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-1ed19fdb-8359-4fa9-9dba-142688066a90 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] [instance: f852a7a7-53cc-4042-8cbe-5b62c0d374a8] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:10.907750 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell0:SELECT=10 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:02:10.913720 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1ed19fdb-8359-4fa9-9dba-142688066a90 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:10.914188 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1ed19fdb-8359-4fa9-9dba-142688066a90 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:10.914606 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1ed19fdb-8359-4fa9-9dba-142688066a90 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:10.915266 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1ed19fdb-8359-4fa9-9dba-142688066a90 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:10.915717 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1ed19fdb-8359-4fa9-9dba-142688066a90 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:10.916161 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1ed19fdb-8359-4fa9-9dba-142688066a90 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:10.920439 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell1:SELECT=100 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:02:11.052898 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-1ed19fdb-8359-4fa9-9dba-142688066a90 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28593deb5eb34bb0b7b2591e85f8f72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5880785dc2475c8268bfd75bc4e675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:11.061250 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-1ed19fdb-8359-4fa9-9dba-142688066a90 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] 10.222.0.58 "GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8" status: 200 len: 1314 microversion: 2.1 time: 0.160048 Aug 31 13:02:11.061947 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 208/396] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:10 2022] GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:11.791040 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-5a0651c1-49e0-474e-9627-a3c474bb333b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:11.792155 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-5a0651c1-49e0-474e-9627-a3c474bb333b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:11.802756 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5a0651c1-49e0-474e-9627-a3c474bb333b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:11.803529 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5a0651c1-49e0-474e-9627-a3c474bb333b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:11.804150 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5a0651c1-49e0-474e-9627-a3c474bb333b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:11.804877 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5a0651c1-49e0-474e-9627-a3c474bb333b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:11.805292 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5a0651c1-49e0-474e-9627-a3c474bb333b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:11.805701 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5a0651c1-49e0-474e-9627-a3c474bb333b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:11.821079 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-6aec3e1d-1cdd-4f7f-8d17-5f0088c168be tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:11.821699 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-6aec3e1d-1cdd-4f7f-8d17-5f0088c168be tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: a7538710-7904-40dc-afac-8d821d6331d5] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:11.828603 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6aec3e1d-1cdd-4f7f-8d17-5f0088c168be tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:11.829088 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6aec3e1d-1cdd-4f7f-8d17-5f0088c168be tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:11.829525 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6aec3e1d-1cdd-4f7f-8d17-5f0088c168be tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:11.830213 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6aec3e1d-1cdd-4f7f-8d17-5f0088c168be tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:11.830649 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6aec3e1d-1cdd-4f7f-8d17-5f0088c168be tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:11.831068 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6aec3e1d-1cdd-4f7f-8d17-5f0088c168be tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:12.002314 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-5a0651c1-49e0-474e-9627-a3c474bb333b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:12.009445 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-6aec3e1d-1cdd-4f7f-8d17-5f0088c168be tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf155bc9925646f59e92f597782a8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c401f76027848f0980f470af73e4473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:12.014232 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-5a0651c1-49e0-474e-9627-a3c474bb333b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1370 microversion: 2.1 time: 0.230321 Aug 31 13:02:12.015053 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 189/397] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:11 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1370 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:12.017445 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-6aec3e1d-1cdd-4f7f-8d17-5f0088c168be tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5" status: 200 len: 1319 microversion: 2.1 time: 0.200420 Aug 31 13:02:12.018017 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 209/398] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:11 2022] GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:12.087342 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-5ee2f1c5-cb86-4783-803a-9376b605f44c tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:12.088457 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-5ee2f1c5-cb86-4783-803a-9376b605f44c tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] [instance: f852a7a7-53cc-4042-8cbe-5b62c0d374a8] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:12.098817 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5ee2f1c5-cb86-4783-803a-9376b605f44c tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:12.099353 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5ee2f1c5-cb86-4783-803a-9376b605f44c tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:12.099968 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5ee2f1c5-cb86-4783-803a-9376b605f44c tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:12.101114 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5ee2f1c5-cb86-4783-803a-9376b605f44c tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:12.101581 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5ee2f1c5-cb86-4783-803a-9376b605f44c tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:12.101980 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5ee2f1c5-cb86-4783-803a-9376b605f44c tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:12.257318 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-5ee2f1c5-cb86-4783-803a-9376b605f44c tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28593deb5eb34bb0b7b2591e85f8f72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5880785dc2475c8268bfd75bc4e675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:12.265522 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-5ee2f1c5-cb86-4783-803a-9376b605f44c tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] 10.222.0.58 "GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8" status: 200 len: 1314 microversion: 2.1 time: 0.185624 Aug 31 13:02:12.266110 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 190/399] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:12 2022] GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:02:13.042961 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e24c9690-4a54-452d-b60a-602ed6ebe11a tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:13.043570 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e24c9690-4a54-452d-b60a-602ed6ebe11a tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: a7538710-7904-40dc-afac-8d821d6331d5] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:13.045514 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-6f21fa2d-f87a-439f-897c-2ccb4e4b2078 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:13.046921 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-6f21fa2d-f87a-439f-897c-2ccb4e4b2078 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:13.051436 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e24c9690-4a54-452d-b60a-602ed6ebe11a tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:13.051925 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e24c9690-4a54-452d-b60a-602ed6ebe11a tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:13.052352 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e24c9690-4a54-452d-b60a-602ed6ebe11a tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:13.053031 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e24c9690-4a54-452d-b60a-602ed6ebe11a tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:13.053563 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e24c9690-4a54-452d-b60a-602ed6ebe11a tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:13.053976 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e24c9690-4a54-452d-b60a-602ed6ebe11a tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:13.056394 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6f21fa2d-f87a-439f-897c-2ccb4e4b2078 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:13.057112 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6f21fa2d-f87a-439f-897c-2ccb4e4b2078 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:13.057764 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6f21fa2d-f87a-439f-897c-2ccb4e4b2078 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:13.058812 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6f21fa2d-f87a-439f-897c-2ccb4e4b2078 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:13.059637 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6f21fa2d-f87a-439f-897c-2ccb4e4b2078 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:13.060902 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6f21fa2d-f87a-439f-897c-2ccb4e4b2078 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:13.316101 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-6f21fa2d-f87a-439f-897c-2ccb4e4b2078 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:13.326536 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-6f21fa2d-f87a-439f-897c-2ccb4e4b2078 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1370 microversion: 2.1 time: 0.293612 Aug 31 13:02:13.327398 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 210/400] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:13 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1370 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:13.332855 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-92bc921b-8ed5-4caa-a877-c9b242fbb889 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:13.333647 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-92bc921b-8ed5-4caa-a877-c9b242fbb889 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] [instance: f852a7a7-53cc-4042-8cbe-5b62c0d374a8] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:13.341760 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-92bc921b-8ed5-4caa-a877-c9b242fbb889 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:13.343470 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-92bc921b-8ed5-4caa-a877-c9b242fbb889 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:13.344560 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-92bc921b-8ed5-4caa-a877-c9b242fbb889 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:13.345652 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-92bc921b-8ed5-4caa-a877-c9b242fbb889 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:13.346115 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-92bc921b-8ed5-4caa-a877-c9b242fbb889 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:13.346250 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e24c9690-4a54-452d-b60a-602ed6ebe11a tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf155bc9925646f59e92f597782a8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c401f76027848f0980f470af73e4473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:13.346533 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-92bc921b-8ed5-4caa-a877-c9b242fbb889 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:13.355838 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e24c9690-4a54-452d-b60a-602ed6ebe11a tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5" status: 200 len: 1319 microversion: 2.1 time: 0.316751 Aug 31 13:02:13.356418 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 191/401] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:13 2022] GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5 => generated 1319 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:13.496908 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-92bc921b-8ed5-4caa-a877-c9b242fbb889 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28593deb5eb34bb0b7b2591e85f8f72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5880785dc2475c8268bfd75bc4e675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:13.505431 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-92bc921b-8ed5-4caa-a877-c9b242fbb889 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] 10.222.0.58 "GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8" status: 200 len: 1314 microversion: 2.1 time: 0.176723 Aug 31 13:02:13.506073 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 211/402] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:13 2022] GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:14.347657 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-c2905520-343f-4488-9e91-00af7c493a11 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:14.348300 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-c2905520-343f-4488-9e91-00af7c493a11 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:14.354891 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c2905520-343f-4488-9e91-00af7c493a11 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:14.355383 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c2905520-343f-4488-9e91-00af7c493a11 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:14.355836 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c2905520-343f-4488-9e91-00af7c493a11 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:14.356551 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c2905520-343f-4488-9e91-00af7c493a11 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:14.357001 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c2905520-343f-4488-9e91-00af7c493a11 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:14.357419 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c2905520-343f-4488-9e91-00af7c493a11 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:14.376931 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-6a031297-6a2e-4db6-b5ff-7a27d30bb89e tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:14.378227 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-6a031297-6a2e-4db6-b5ff-7a27d30bb89e tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: a7538710-7904-40dc-afac-8d821d6331d5] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:14.385802 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6a031297-6a2e-4db6-b5ff-7a27d30bb89e tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:14.390100 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6a031297-6a2e-4db6-b5ff-7a27d30bb89e tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:14.391089 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6a031297-6a2e-4db6-b5ff-7a27d30bb89e tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:14.392346 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6a031297-6a2e-4db6-b5ff-7a27d30bb89e tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:14.393431 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6a031297-6a2e-4db6-b5ff-7a27d30bb89e tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:14.394169 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6a031297-6a2e-4db6-b5ff-7a27d30bb89e tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:14.588896 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-c2905520-343f-4488-9e91-00af7c493a11 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:14.593759 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-6a031297-6a2e-4db6-b5ff-7a27d30bb89e tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf155bc9925646f59e92f597782a8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c401f76027848f0980f470af73e4473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:14.598717 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-c2905520-343f-4488-9e91-00af7c493a11 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1370 microversion: 2.1 time: 0.255244 Aug 31 13:02:14.599331 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 192/403] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:14 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1370 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:14.604943 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-7cb582fe-6ba1-419d-ab06-0094fd180780 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:14.605535 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-7cb582fe-6ba1-419d-ab06-0094fd180780 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] [instance: f852a7a7-53cc-4042-8cbe-5b62c0d374a8] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:14.610628 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-6a031297-6a2e-4db6-b5ff-7a27d30bb89e tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5" status: 200 len: 1319 microversion: 2.1 time: 0.237913 Aug 31 13:02:14.612757 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 212/404] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:14 2022] GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5 => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:14.613930 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7cb582fe-6ba1-419d-ab06-0094fd180780 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:14.614404 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7cb582fe-6ba1-419d-ab06-0094fd180780 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:14.614825 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7cb582fe-6ba1-419d-ab06-0094fd180780 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:14.615510 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7cb582fe-6ba1-419d-ab06-0094fd180780 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:14.616043 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7cb582fe-6ba1-419d-ab06-0094fd180780 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:14.616460 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7cb582fe-6ba1-419d-ab06-0094fd180780 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:14.749777 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-7cb582fe-6ba1-419d-ab06-0094fd180780 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28593deb5eb34bb0b7b2591e85f8f72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5880785dc2475c8268bfd75bc4e675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:14.757903 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-7cb582fe-6ba1-419d-ab06-0094fd180780 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] 10.222.0.58 "GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8" status: 200 len: 1314 microversion: 2.1 time: 0.156600 Aug 31 13:02:14.758700 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 193/405] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:14 2022] GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:15.626632 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-ccdbfced-48d1-456b-89a8-403ce6ea08a1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:15.627218 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-ccdbfced-48d1-456b-89a8-403ce6ea08a1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:15.633525 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-8a330973-2c1d-49dc-ac57-7e26a2af7eb4 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:15.634150 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ccdbfced-48d1-456b-89a8-403ce6ea08a1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:15.634291 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-8a330973-2c1d-49dc-ac57-7e26a2af7eb4 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: a7538710-7904-40dc-afac-8d821d6331d5] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:15.634624 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ccdbfced-48d1-456b-89a8-403ce6ea08a1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:15.635048 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ccdbfced-48d1-456b-89a8-403ce6ea08a1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:15.635748 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ccdbfced-48d1-456b-89a8-403ce6ea08a1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:15.636252 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ccdbfced-48d1-456b-89a8-403ce6ea08a1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:15.636671 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ccdbfced-48d1-456b-89a8-403ce6ea08a1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:15.640468 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8a330973-2c1d-49dc-ac57-7e26a2af7eb4 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:15.641020 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8a330973-2c1d-49dc-ac57-7e26a2af7eb4 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:15.641443 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8a330973-2c1d-49dc-ac57-7e26a2af7eb4 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:15.642179 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8a330973-2c1d-49dc-ac57-7e26a2af7eb4 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:15.642616 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8a330973-2c1d-49dc-ac57-7e26a2af7eb4 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:15.643024 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8a330973-2c1d-49dc-ac57-7e26a2af7eb4 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:15.844160 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-ccdbfced-48d1-456b-89a8-403ce6ea08a1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:15.848812 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-8a330973-2c1d-49dc-ac57-7e26a2af7eb4 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf155bc9925646f59e92f597782a8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c401f76027848f0980f470af73e4473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:15.854098 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-ccdbfced-48d1-456b-89a8-403ce6ea08a1 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1370 microversion: 2.1 time: 0.231308 Aug 31 13:02:15.854686 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 213/406] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:15 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1370 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:15.857476 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-8a330973-2c1d-49dc-ac57-7e26a2af7eb4 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5" status: 200 len: 1319 microversion: 2.1 time: 0.228544 Aug 31 13:02:15.858395 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 194/407] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:15 2022] GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:15.859802 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-36775951-8d79-470e-a634-1641eb0b7053 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:15.860452 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-36775951-8d79-470e-a634-1641eb0b7053 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] [instance: f852a7a7-53cc-4042-8cbe-5b62c0d374a8] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:15.875327 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-36775951-8d79-470e-a634-1641eb0b7053 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:15.875327 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-36775951-8d79-470e-a634-1641eb0b7053 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:15.875327 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-36775951-8d79-470e-a634-1641eb0b7053 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:15.875327 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-36775951-8d79-470e-a634-1641eb0b7053 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:15.875882 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-36775951-8d79-470e-a634-1641eb0b7053 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:15.875882 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-36775951-8d79-470e-a634-1641eb0b7053 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:16.016456 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-36775951-8d79-470e-a634-1641eb0b7053 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28593deb5eb34bb0b7b2591e85f8f72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5880785dc2475c8268bfd75bc4e675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:16.025606 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-36775951-8d79-470e-a634-1641eb0b7053 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] 10.222.0.58 "GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8" status: 200 len: 1314 microversion: 2.1 time: 0.169860 Aug 31 13:02:16.026235 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 214/408] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:15 2022] GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:16.803223 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-6c5c38dc-3e0a-42bf-a9ec-694835ffa2cf req-152a13a6-5d34-40a4-b794-676dda98dacc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec", "name": "network-vif-plugged", "status": "completed", "tag": "d45b253a-763d-4df7-b467-4cfc91042795"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:02:16.813506 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-6c5c38dc-3e0a-42bf-a9ec-694835ffa2cf req-152a13a6-5d34-40a4-b794-676dda98dacc service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:16.814078 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-6c5c38dc-3e0a-42bf-a9ec-694835ffa2cf req-152a13a6-5d34-40a4-b794-676dda98dacc service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:16.815378 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-6c5c38dc-3e0a-42bf-a9ec-694835ffa2cf req-152a13a6-5d34-40a4-b794-676dda98dacc service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:16.827057 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-6c5c38dc-3e0a-42bf-a9ec-694835ffa2cf req-152a13a6-5d34-40a4-b794-676dda98dacc service nova] Creating event network-vif-plugged:d45b253a-763d-4df7-b467-4cfc91042795 for instance dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec on hv-cinder-85442 Aug 31 13:02:16.832384 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-6c5c38dc-3e0a-42bf-a9ec-694835ffa2cf req-152a13a6-5d34-40a4-b794-676dda98dacc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032986 Aug 31 13:02:16.833202 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 195/409] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:02:16.879158 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-27044308-fd37-46e1-a0fa-f7c271564307 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:16.879861 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-27044308-fd37-46e1-a0fa-f7c271564307 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:16.882800 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-4e0389be-fde7-4024-93c3-f028eeada80a tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:16.883547 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-4e0389be-fde7-4024-93c3-f028eeada80a tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: a7538710-7904-40dc-afac-8d821d6331d5] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:16.886694 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-27044308-fd37-46e1-a0fa-f7c271564307 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:16.887190 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-27044308-fd37-46e1-a0fa-f7c271564307 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:16.887623 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-27044308-fd37-46e1-a0fa-f7c271564307 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:16.888350 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-27044308-fd37-46e1-a0fa-f7c271564307 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:16.888832 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-27044308-fd37-46e1-a0fa-f7c271564307 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:16.889255 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-27044308-fd37-46e1-a0fa-f7c271564307 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:16.889721 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4e0389be-fde7-4024-93c3-f028eeada80a tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:16.890195 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4e0389be-fde7-4024-93c3-f028eeada80a tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:16.890674 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4e0389be-fde7-4024-93c3-f028eeada80a tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:16.891361 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4e0389be-fde7-4024-93c3-f028eeada80a tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:16.891806 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4e0389be-fde7-4024-93c3-f028eeada80a tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:16.892245 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4e0389be-fde7-4024-93c3-f028eeada80a tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:17.090493 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-27044308-fd37-46e1-a0fa-f7c271564307 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:17.094751 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-4e0389be-fde7-4024-93c3-f028eeada80a tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf155bc9925646f59e92f597782a8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c401f76027848f0980f470af73e4473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:17.101943 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-27044308-fd37-46e1-a0fa-f7c271564307 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1370 microversion: 2.1 time: 0.227586 Aug 31 13:02:17.102723 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 215/410] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:16 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1370 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:17.105347 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-4e0389be-fde7-4024-93c3-f028eeada80a tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5" status: 200 len: 1319 microversion: 2.1 time: 0.226721 Aug 31 13:02:17.106413 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 196/411] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:16 2022] GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5 => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:02:17.107468 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-6a427d48-f04b-420a-b5c7-f0219d618155 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:17.108107 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-6a427d48-f04b-420a-b5c7-f0219d618155 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] [instance: f852a7a7-53cc-4042-8cbe-5b62c0d374a8] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:17.114340 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6a427d48-f04b-420a-b5c7-f0219d618155 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:17.114830 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6a427d48-f04b-420a-b5c7-f0219d618155 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:17.115267 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6a427d48-f04b-420a-b5c7-f0219d618155 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:17.116005 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6a427d48-f04b-420a-b5c7-f0219d618155 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:17.116500 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6a427d48-f04b-420a-b5c7-f0219d618155 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:17.116865 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6a427d48-f04b-420a-b5c7-f0219d618155 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:17.255653 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-6a427d48-f04b-420a-b5c7-f0219d618155 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28593deb5eb34bb0b7b2591e85f8f72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5880785dc2475c8268bfd75bc4e675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:17.264871 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-6a427d48-f04b-420a-b5c7-f0219d618155 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] 10.222.0.58 "GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8" status: 200 len: 1314 microversion: 2.1 time: 0.160941 Aug 31 13:02:17.265543 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 216/412] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:17 2022] GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:18.122952 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-37b8ddcb-3851-40cb-b92b-5ccb7a548186 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:18.123502 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-37b8ddcb-3851-40cb-b92b-5ccb7a548186 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:18.126939 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-66111845-dedd-45b4-9168-b2cfa1fb4bb1 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:18.127531 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-66111845-dedd-45b4-9168-b2cfa1fb4bb1 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: a7538710-7904-40dc-afac-8d821d6331d5] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:18.130165 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-37b8ddcb-3851-40cb-b92b-5ccb7a548186 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:18.130625 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-37b8ddcb-3851-40cb-b92b-5ccb7a548186 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:18.131046 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-37b8ddcb-3851-40cb-b92b-5ccb7a548186 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:18.131755 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-37b8ddcb-3851-40cb-b92b-5ccb7a548186 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:18.132224 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-37b8ddcb-3851-40cb-b92b-5ccb7a548186 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:18.132633 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-37b8ddcb-3851-40cb-b92b-5ccb7a548186 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:18.135921 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-66111845-dedd-45b4-9168-b2cfa1fb4bb1 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:18.137984 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-66111845-dedd-45b4-9168-b2cfa1fb4bb1 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:18.137984 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-66111845-dedd-45b4-9168-b2cfa1fb4bb1 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:18.137984 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-66111845-dedd-45b4-9168-b2cfa1fb4bb1 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:18.138337 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-66111845-dedd-45b4-9168-b2cfa1fb4bb1 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:18.138490 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-66111845-dedd-45b4-9168-b2cfa1fb4bb1 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:18.323829 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-37b8ddcb-3851-40cb-b92b-5ccb7a548186 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:18.331195 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-66111845-dedd-45b4-9168-b2cfa1fb4bb1 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf155bc9925646f59e92f597782a8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c401f76027848f0980f470af73e4473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:18.334944 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-37b8ddcb-3851-40cb-b92b-5ccb7a548186 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1370 microversion: 2.1 time: 0.215863 Aug 31 13:02:18.335508 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 197/413] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:18 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1370 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:18.339713 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-66111845-dedd-45b4-9168-b2cfa1fb4bb1 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5" status: 200 len: 1319 microversion: 2.1 time: 0.217447 Aug 31 13:02:18.343880 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-34bdce68-a26c-47eb-8dd3-989b44519d9f tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:18.343880 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-34bdce68-a26c-47eb-8dd3-989b44519d9f tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] [instance: f852a7a7-53cc-4042-8cbe-5b62c0d374a8] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:18.347789 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-34bdce68-a26c-47eb-8dd3-989b44519d9f tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:18.348382 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-34bdce68-a26c-47eb-8dd3-989b44519d9f tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:18.348817 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-34bdce68-a26c-47eb-8dd3-989b44519d9f tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:18.349518 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-34bdce68-a26c-47eb-8dd3-989b44519d9f tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:18.350175 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-34bdce68-a26c-47eb-8dd3-989b44519d9f tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:18.350723 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 217/414] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:18 2022] GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5 => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:18.350843 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-34bdce68-a26c-47eb-8dd3-989b44519d9f tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:18.483575 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-34bdce68-a26c-47eb-8dd3-989b44519d9f tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28593deb5eb34bb0b7b2591e85f8f72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5880785dc2475c8268bfd75bc4e675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:18.494493 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-34bdce68-a26c-47eb-8dd3-989b44519d9f tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] 10.222.0.58 "GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8" status: 200 len: 1314 microversion: 2.1 time: 0.157541 Aug 31 13:02:18.495145 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 198/415] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:18 2022] GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:19.361060 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-0a20fd3f-7bef-4ddd-9f59-7a1c30fee396 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:19.361700 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-0a20fd3f-7bef-4ddd-9f59-7a1c30fee396 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:19.362259 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-fe583450-8430-4c6c-bf2f-6fd30b536d5d tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:19.362869 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-fe583450-8430-4c6c-bf2f-6fd30b536d5d tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: a7538710-7904-40dc-afac-8d821d6331d5] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:19.368583 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0a20fd3f-7bef-4ddd-9f59-7a1c30fee396 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:19.369062 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0a20fd3f-7bef-4ddd-9f59-7a1c30fee396 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:19.369205 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fe583450-8430-4c6c-bf2f-6fd30b536d5d tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:19.369488 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0a20fd3f-7bef-4ddd-9f59-7a1c30fee396 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:19.369654 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fe583450-8430-4c6c-bf2f-6fd30b536d5d tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:19.370074 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fe583450-8430-4c6c-bf2f-6fd30b536d5d tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:19.370239 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0a20fd3f-7bef-4ddd-9f59-7a1c30fee396 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:19.370629 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0a20fd3f-7bef-4ddd-9f59-7a1c30fee396 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:19.370784 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fe583450-8430-4c6c-bf2f-6fd30b536d5d tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:19.371044 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0a20fd3f-7bef-4ddd-9f59-7a1c30fee396 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:19.371188 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fe583450-8430-4c6c-bf2f-6fd30b536d5d tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:19.371547 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fe583450-8430-4c6c-bf2f-6fd30b536d5d tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:19.575318 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-fe583450-8430-4c6c-bf2f-6fd30b536d5d tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf155bc9925646f59e92f597782a8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c401f76027848f0980f470af73e4473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:19.579212 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-0a20fd3f-7bef-4ddd-9f59-7a1c30fee396 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:19.584276 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-fe583450-8430-4c6c-bf2f-6fd30b536d5d tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5" status: 200 len: 1319 microversion: 2.1 time: 0.226125 Aug 31 13:02:19.584903 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 199/416] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:19 2022] GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5 => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:19.587840 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-0a20fd3f-7bef-4ddd-9f59-7a1c30fee396 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1370 microversion: 2.1 time: 0.232148 Aug 31 13:02:19.588530 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 218/417] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:19 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1370 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:19.589600 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-237e6e7b-7b15-49de-88e9-1961fd5ca080 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:19.590206 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-237e6e7b-7b15-49de-88e9-1961fd5ca080 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] [instance: f852a7a7-53cc-4042-8cbe-5b62c0d374a8] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:19.597526 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-237e6e7b-7b15-49de-88e9-1961fd5ca080 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:19.597526 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-237e6e7b-7b15-49de-88e9-1961fd5ca080 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:19.597526 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-237e6e7b-7b15-49de-88e9-1961fd5ca080 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:19.598448 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-237e6e7b-7b15-49de-88e9-1961fd5ca080 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:19.604162 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-237e6e7b-7b15-49de-88e9-1961fd5ca080 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:19.605018 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-237e6e7b-7b15-49de-88e9-1961fd5ca080 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:19.752088 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-237e6e7b-7b15-49de-88e9-1961fd5ca080 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28593deb5eb34bb0b7b2591e85f8f72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5880785dc2475c8268bfd75bc4e675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:19.760805 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-237e6e7b-7b15-49de-88e9-1961fd5ca080 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] 10.222.0.58 "GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8" status: 200 len: 1463 microversion: 2.1 time: 0.174846 Aug 31 13:02:19.761429 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 200/418] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:19 2022] GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8 => generated 1463 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:19.808717 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-21e6130e-d229-4bb0-a3e8-93df9e7c8b8b tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:19.809207 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-21e6130e-d229-4bb0-a3e8-93df9e7c8b8b tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] [instance: f852a7a7-53cc-4042-8cbe-5b62c0d374a8] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:19.817116 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-21e6130e-d229-4bb0-a3e8-93df9e7c8b8b tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:19.817638 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-21e6130e-d229-4bb0-a3e8-93df9e7c8b8b tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:19.818236 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-21e6130e-d229-4bb0-a3e8-93df9e7c8b8b tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:19.818993 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-21e6130e-d229-4bb0-a3e8-93df9e7c8b8b tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:19.819854 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-21e6130e-d229-4bb0-a3e8-93df9e7c8b8b tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:19.819854 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-21e6130e-d229-4bb0-a3e8-93df9e7c8b8b tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:19.847106 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-21e6130e-d229-4bb0-a3e8-93df9e7c8b8b tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] [instance: f852a7a7-53cc-4042-8cbe-5b62c0d374a8] Going to try to terminate instance {{(pid=120704) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 13:02:19.934175 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-21e6130e-d229-4bb0-a3e8-93df9e7c8b8b tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8" status: 204 len: 0 microversion: 2.1 time: 0.129484 Aug 31 13:02:19.934905 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 219/419] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 31 13:02:19 2022] DELETE /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:02:19.943673 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-ebe4854f-6596-47d1-ab0c-2d7cf802c006 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:19.944383 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-ebe4854f-6596-47d1-ab0c-2d7cf802c006 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] [instance: f852a7a7-53cc-4042-8cbe-5b62c0d374a8] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:19.950565 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ebe4854f-6596-47d1-ab0c-2d7cf802c006 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:19.951032 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ebe4854f-6596-47d1-ab0c-2d7cf802c006 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:19.951460 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ebe4854f-6596-47d1-ab0c-2d7cf802c006 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:19.952184 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ebe4854f-6596-47d1-ab0c-2d7cf802c006 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:19.952607 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ebe4854f-6596-47d1-ab0c-2d7cf802c006 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:19.953020 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ebe4854f-6596-47d1-ab0c-2d7cf802c006 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:20.110945 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=100 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:02:20.246977 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-ebe4854f-6596-47d1-ab0c-2d7cf802c006 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28593deb5eb34bb0b7b2591e85f8f72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5880785dc2475c8268bfd75bc4e675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:20.258387 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-ebe4854f-6596-47d1-ab0c-2d7cf802c006 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] 10.222.0.58 "GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8" status: 200 len: 1469 microversion: 2.1 time: 0.318740 Aug 31 13:02:20.259140 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 201/420] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:19 2022] GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8 => generated 1469 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:20.606758 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-ea1247d4-1b7b-4556-90c5-667c8e7812b2 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:20.607447 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-ea1247d4-1b7b-4556-90c5-667c8e7812b2 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: a7538710-7904-40dc-afac-8d821d6331d5] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:20.610522 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-bc031e61-5ff8-4ab2-805a-6c3bc5582197 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:20.611699 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-bc031e61-5ff8-4ab2-805a-6c3bc5582197 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:20.613836 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ea1247d4-1b7b-4556-90c5-667c8e7812b2 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:20.614310 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ea1247d4-1b7b-4556-90c5-667c8e7812b2 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:20.614732 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ea1247d4-1b7b-4556-90c5-667c8e7812b2 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:20.615414 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ea1247d4-1b7b-4556-90c5-667c8e7812b2 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:20.615859 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ea1247d4-1b7b-4556-90c5-667c8e7812b2 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:20.616283 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ea1247d4-1b7b-4556-90c5-667c8e7812b2 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:20.618022 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bc031e61-5ff8-4ab2-805a-6c3bc5582197 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:20.618505 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bc031e61-5ff8-4ab2-805a-6c3bc5582197 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:20.618946 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bc031e61-5ff8-4ab2-805a-6c3bc5582197 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:20.619634 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bc031e61-5ff8-4ab2-805a-6c3bc5582197 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:20.620115 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bc031e61-5ff8-4ab2-805a-6c3bc5582197 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:20.620521 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bc031e61-5ff8-4ab2-805a-6c3bc5582197 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:20.812470 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-ea1247d4-1b7b-4556-90c5-667c8e7812b2 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf155bc9925646f59e92f597782a8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c401f76027848f0980f470af73e4473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:20.815294 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-bc031e61-5ff8-4ab2-805a-6c3bc5582197 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:20.820412 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-ea1247d4-1b7b-4556-90c5-667c8e7812b2 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5" status: 200 len: 1319 microversion: 2.1 time: 0.218092 Aug 31 13:02:20.821149 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 220/421] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:20 2022] GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5 => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:20.831048 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-bc031e61-5ff8-4ab2-805a-6c3bc5582197 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1370 microversion: 2.1 time: 0.224309 Aug 31 13:02:20.831786 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 202/422] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:20 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1370 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:21.286179 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-c77a7dce-b300-4dbf-9f1d-770ee9193ea2 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:21.287606 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-c77a7dce-b300-4dbf-9f1d-770ee9193ea2 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] [instance: f852a7a7-53cc-4042-8cbe-5b62c0d374a8] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:21.299647 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c77a7dce-b300-4dbf-9f1d-770ee9193ea2 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:21.300544 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c77a7dce-b300-4dbf-9f1d-770ee9193ea2 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:21.301315 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c77a7dce-b300-4dbf-9f1d-770ee9193ea2 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:21.302466 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c77a7dce-b300-4dbf-9f1d-770ee9193ea2 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:21.303306 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c77a7dce-b300-4dbf-9f1d-770ee9193ea2 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:21.304057 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c77a7dce-b300-4dbf-9f1d-770ee9193ea2 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:21.448061 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-c77a7dce-b300-4dbf-9f1d-770ee9193ea2 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28593deb5eb34bb0b7b2591e85f8f72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5880785dc2475c8268bfd75bc4e675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:21.456212 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-c77a7dce-b300-4dbf-9f1d-770ee9193ea2 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] 10.222.0.58 "GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8" status: 200 len: 1469 microversion: 2.1 time: 0.176509 Aug 31 13:02:21.456796 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 221/423] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:21 2022] GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8 => generated 1469 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:21.841341 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b35444b9-d961-4270-94ab-d4cc54e3c675 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:21.841941 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b35444b9-d961-4270-94ab-d4cc54e3c675 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: a7538710-7904-40dc-afac-8d821d6331d5] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:21.848023 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b35444b9-d961-4270-94ab-d4cc54e3c675 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:21.848502 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b35444b9-d961-4270-94ab-d4cc54e3c675 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:21.848924 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b35444b9-d961-4270-94ab-d4cc54e3c675 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:21.849596 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b35444b9-d961-4270-94ab-d4cc54e3c675 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:21.850034 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b35444b9-d961-4270-94ab-d4cc54e3c675 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:21.850437 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b35444b9-d961-4270-94ab-d4cc54e3c675 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:21.852567 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-8364a9f4-f3f8-4f9d-b9fc-f3b7a5821ca5 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:21.853110 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-8364a9f4-f3f8-4f9d-b9fc-f3b7a5821ca5 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:21.860429 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8364a9f4-f3f8-4f9d-b9fc-f3b7a5821ca5 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:21.860914 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8364a9f4-f3f8-4f9d-b9fc-f3b7a5821ca5 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:21.861344 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8364a9f4-f3f8-4f9d-b9fc-f3b7a5821ca5 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:21.862039 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8364a9f4-f3f8-4f9d-b9fc-f3b7a5821ca5 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:21.862698 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8364a9f4-f3f8-4f9d-b9fc-f3b7a5821ca5 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:21.863118 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8364a9f4-f3f8-4f9d-b9fc-f3b7a5821ca5 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:22.267437 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-b35444b9-d961-4270-94ab-d4cc54e3c675 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf155bc9925646f59e92f597782a8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c401f76027848f0980f470af73e4473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:22.275021 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-8364a9f4-f3f8-4f9d-b9fc-f3b7a5821ca5 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:22.276178 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b35444b9-d961-4270-94ab-d4cc54e3c675 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5" status: 200 len: 1319 microversion: 2.1 time: 0.438547 Aug 31 13:02:22.276919 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 203/424] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:21 2022] GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5 => generated 1319 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:22.287772 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-8364a9f4-f3f8-4f9d-b9fc-f3b7a5821ca5 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1370 microversion: 2.1 time: 0.438751 Aug 31 13:02:22.288598 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 222/425] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:21 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1370 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:02:22.481402 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-1b204719-e93e-4b43-8ead-0af03d43814c tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:22.482443 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-1b204719-e93e-4b43-8ead-0af03d43814c tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] [instance: f852a7a7-53cc-4042-8cbe-5b62c0d374a8] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:22.489483 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1b204719-e93e-4b43-8ead-0af03d43814c tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:22.490018 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1b204719-e93e-4b43-8ead-0af03d43814c tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:22.490495 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1b204719-e93e-4b43-8ead-0af03d43814c tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:22.493321 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1b204719-e93e-4b43-8ead-0af03d43814c tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:22.493824 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1b204719-e93e-4b43-8ead-0af03d43814c tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:22.494287 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1b204719-e93e-4b43-8ead-0af03d43814c tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:22.628158 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-1b204719-e93e-4b43-8ead-0af03d43814c tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28593deb5eb34bb0b7b2591e85f8f72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5880785dc2475c8268bfd75bc4e675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:22.635959 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-1b204719-e93e-4b43-8ead-0af03d43814c tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] 10.222.0.58 "GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8" status: 200 len: 1469 microversion: 2.1 time: 0.161050 Aug 31 13:02:22.636536 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 204/426] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:22 2022] GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8 => generated 1469 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:23.299890 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-f0a35c13-48a7-4ccc-8c33-05fd273e5aa9 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:23.300750 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-f0a35c13-48a7-4ccc-8c33-05fd273e5aa9 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: a7538710-7904-40dc-afac-8d821d6331d5] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:23.308620 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f0a35c13-48a7-4ccc-8c33-05fd273e5aa9 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:23.309125 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f0a35c13-48a7-4ccc-8c33-05fd273e5aa9 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:23.309292 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-f6406b35-9314-4e97-8549-9e56dca72b27 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:23.309759 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f0a35c13-48a7-4ccc-8c33-05fd273e5aa9 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:23.309940 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-f6406b35-9314-4e97-8549-9e56dca72b27 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:23.310385 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f0a35c13-48a7-4ccc-8c33-05fd273e5aa9 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:23.310835 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f0a35c13-48a7-4ccc-8c33-05fd273e5aa9 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:23.311287 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f0a35c13-48a7-4ccc-8c33-05fd273e5aa9 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:23.315755 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:02:23.316422 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f6406b35-9314-4e97-8549-9e56dca72b27 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:23.316930 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f6406b35-9314-4e97-8549-9e56dca72b27 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:23.317363 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f6406b35-9314-4e97-8549-9e56dca72b27 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:23.318137 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f6406b35-9314-4e97-8549-9e56dca72b27 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:23.318589 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f6406b35-9314-4e97-8549-9e56dca72b27 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:23.319054 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f6406b35-9314-4e97-8549-9e56dca72b27 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:23.508334 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-f0a35c13-48a7-4ccc-8c33-05fd273e5aa9 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf155bc9925646f59e92f597782a8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c401f76027848f0980f470af73e4473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:23.511523 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-f6406b35-9314-4e97-8549-9e56dca72b27 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:23.516538 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-f0a35c13-48a7-4ccc-8c33-05fd273e5aa9 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5" status: 200 len: 1319 microversion: 2.1 time: 0.221979 Aug 31 13:02:23.517130 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 223/427] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:23 2022] GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5 => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:23.519293 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-f6406b35-9314-4e97-8549-9e56dca72b27 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1370 microversion: 2.1 time: 0.214052 Aug 31 13:02:23.519921 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 205/428] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:23 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1370 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:23.657048 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-782ab16a-7749-4da2-b9f0-d2c93b19d048 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:23.657654 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-782ab16a-7749-4da2-b9f0-d2c93b19d048 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] [instance: f852a7a7-53cc-4042-8cbe-5b62c0d374a8] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:23.664740 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-782ab16a-7749-4da2-b9f0-d2c93b19d048 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:23.665218 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-782ab16a-7749-4da2-b9f0-d2c93b19d048 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:23.665643 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-782ab16a-7749-4da2-b9f0-d2c93b19d048 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:23.666328 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-782ab16a-7749-4da2-b9f0-d2c93b19d048 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:23.666772 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-782ab16a-7749-4da2-b9f0-d2c93b19d048 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:23.667187 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-782ab16a-7749-4da2-b9f0-d2c93b19d048 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:23.753088 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-ad10d1ae-c4e3-4692-a718-1ad95d987361 req-331b3349-1345-45f8-a9b7-893f9caefd53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7538710-7904-40dc-afac-8d821d6331d5", "name": "network-vif-plugged", "status": "completed", "tag": "9ea0da77-0025-427d-9a88-7cd21356e351"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:02:23.763312 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-ad10d1ae-c4e3-4692-a718-1ad95d987361 req-331b3349-1345-45f8-a9b7-893f9caefd53 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:23.764032 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-ad10d1ae-c4e3-4692-a718-1ad95d987361 req-331b3349-1345-45f8-a9b7-893f9caefd53 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:23.764525 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-ad10d1ae-c4e3-4692-a718-1ad95d987361 req-331b3349-1345-45f8-a9b7-893f9caefd53 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:23.778591 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-ad10d1ae-c4e3-4692-a718-1ad95d987361 req-331b3349-1345-45f8-a9b7-893f9caefd53 service nova] Creating event network-vif-plugged:9ea0da77-0025-427d-9a88-7cd21356e351 for instance a7538710-7904-40dc-afac-8d821d6331d5 on hv-cinder-85442 Aug 31 13:02:23.784035 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-ad10d1ae-c4e3-4692-a718-1ad95d987361 req-331b3349-1345-45f8-a9b7-893f9caefd53 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034669 Aug 31 13:02:23.784753 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 206/429] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:02:23.804641 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-782ab16a-7749-4da2-b9f0-d2c93b19d048 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28593deb5eb34bb0b7b2591e85f8f72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5880785dc2475c8268bfd75bc4e675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:23.812474 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-782ab16a-7749-4da2-b9f0-d2c93b19d048 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] 10.222.0.58 "GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8" status: 200 len: 1469 microversion: 2.1 time: 0.159446 Aug 31 13:02:23.813052 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 224/430] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:23 2022] GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8 => generated 1469 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:02:24.540781 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-bbbd3604-caa5-494c-9ac0-2f21e1331c4b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:24.541495 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-eda43e29-9c82-4a50-868d-79837dcc6967 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:24.542422 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-bbbd3604-caa5-494c-9ac0-2f21e1331c4b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:24.543364 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-eda43e29-9c82-4a50-868d-79837dcc6967 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: a7538710-7904-40dc-afac-8d821d6331d5] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:24.550241 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bbbd3604-caa5-494c-9ac0-2f21e1331c4b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:24.550850 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-eda43e29-9c82-4a50-868d-79837dcc6967 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:24.551335 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-eda43e29-9c82-4a50-868d-79837dcc6967 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:24.551618 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bbbd3604-caa5-494c-9ac0-2f21e1331c4b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:24.551850 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-eda43e29-9c82-4a50-868d-79837dcc6967 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:24.552621 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bbbd3604-caa5-494c-9ac0-2f21e1331c4b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:24.552843 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-eda43e29-9c82-4a50-868d-79837dcc6967 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:24.553356 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-eda43e29-9c82-4a50-868d-79837dcc6967 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:24.553869 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-eda43e29-9c82-4a50-868d-79837dcc6967 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:24.554323 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bbbd3604-caa5-494c-9ac0-2f21e1331c4b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:24.555195 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bbbd3604-caa5-494c-9ac0-2f21e1331c4b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:24.555887 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bbbd3604-caa5-494c-9ac0-2f21e1331c4b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:24.785927 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-bbbd3604-caa5-494c-9ac0-2f21e1331c4b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:24.796149 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-bbbd3604-caa5-494c-9ac0-2f21e1331c4b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1565 microversion: 2.1 time: 0.259953 Aug 31 13:02:24.796821 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 225/431] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:24 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1565 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:24.804056 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-eda43e29-9c82-4a50-868d-79837dcc6967 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf155bc9925646f59e92f597782a8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c401f76027848f0980f470af73e4473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:24.807781 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-2b1903cf-80bb-4dd2-9046-2174a964a906 req-a8bcef62-7063-421c-bfc5-35b5cd154f79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f852a7a7-53cc-4042-8cbe-5b62c0d374a8", "name": "network-vif-deleted", "tag": "4ccd8af6-a4d1-4200-bdd5-e7d2aec7f3ca"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:02:24.813013 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-eda43e29-9c82-4a50-868d-79837dcc6967 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5" status: 200 len: 1319 microversion: 2.1 time: 0.277090 Aug 31 13:02:24.813917 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 207/432] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:24 2022] GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5 => generated 1319 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:24.818902 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-4572716a-159e-4153-9d72-db1b105653f9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:24.819264 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-2b1903cf-80bb-4dd2-9046-2174a964a906 req-a8bcef62-7063-421c-bfc5-35b5cd154f79 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:24.819398 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-4572716a-159e-4153-9d72-db1b105653f9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:24.820047 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-2b1903cf-80bb-4dd2-9046-2174a964a906 req-a8bcef62-7063-421c-bfc5-35b5cd154f79 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:24.820631 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-2b1903cf-80bb-4dd2-9046-2174a964a906 req-a8bcef62-7063-421c-bfc5-35b5cd154f79 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:24.827008 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4572716a-159e-4153-9d72-db1b105653f9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:24.827496 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4572716a-159e-4153-9d72-db1b105653f9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:24.828005 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4572716a-159e-4153-9d72-db1b105653f9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:24.829017 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4572716a-159e-4153-9d72-db1b105653f9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:24.829468 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4572716a-159e-4153-9d72-db1b105653f9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:24.829912 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4572716a-159e-4153-9d72-db1b105653f9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:24.836599 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-2b1903cf-80bb-4dd2-9046-2174a964a906 req-a8bcef62-7063-421c-bfc5-35b5cd154f79 service nova] Creating event network-vif-deleted:4ccd8af6-a4d1-4200-bdd5-e7d2aec7f3ca for instance f852a7a7-53cc-4042-8cbe-5b62c0d374a8 on hv-cinder-85442 Aug 31 13:02:24.841728 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-2b1903cf-80bb-4dd2-9046-2174a964a906 req-a8bcef62-7063-421c-bfc5-35b5cd154f79 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039290 Aug 31 13:02:24.842324 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 226/433] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:02:24.848560 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-d87be9db-7cd9-46ca-97e2-8562b8f1382a tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:24.849268 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-d87be9db-7cd9-46ca-97e2-8562b8f1382a tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] [instance: f852a7a7-53cc-4042-8cbe-5b62c0d374a8] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:24.855784 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d87be9db-7cd9-46ca-97e2-8562b8f1382a tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:24.856309 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d87be9db-7cd9-46ca-97e2-8562b8f1382a tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:24.856803 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d87be9db-7cd9-46ca-97e2-8562b8f1382a tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:24.857508 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d87be9db-7cd9-46ca-97e2-8562b8f1382a tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:24.857953 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d87be9db-7cd9-46ca-97e2-8562b8f1382a tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:24.858628 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d87be9db-7cd9-46ca-97e2-8562b8f1382a tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:24.931218 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-d87be9db-7cd9-46ca-97e2-8562b8f1382a tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28593deb5eb34bb0b7b2591e85f8f72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5880785dc2475c8268bfd75bc4e675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:24.939770 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-d87be9db-7cd9-46ca-97e2-8562b8f1382a tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] 10.222.0.58 "GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8" status: 200 len: 1299 microversion: 2.1 time: 0.096070 Aug 31 13:02:24.942665 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-4572716a-159e-4153-9d72-db1b105653f9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.127202 Aug 31 13:02:24.943567 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 208/434] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 31 13:02:24 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec/os-interface => generated 285 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:02:24.943711 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 227/435] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:24 2022] GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8 => generated 1299 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:25.837347 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-cb66beb1-f44b-4cd9-b353-ae55e746ef4e tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:25.838070 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-cb66beb1-f44b-4cd9-b353-ae55e746ef4e tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: a7538710-7904-40dc-afac-8d821d6331d5] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:25.844554 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cb66beb1-f44b-4cd9-b353-ae55e746ef4e tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:25.845033 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cb66beb1-f44b-4cd9-b353-ae55e746ef4e tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:25.845462 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cb66beb1-f44b-4cd9-b353-ae55e746ef4e tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:25.846158 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cb66beb1-f44b-4cd9-b353-ae55e746ef4e tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:25.846604 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cb66beb1-f44b-4cd9-b353-ae55e746ef4e tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:25.847019 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cb66beb1-f44b-4cd9-b353-ae55e746ef4e tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:25.960848 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-6f1d6993-1585-4cbe-a31a-668d491e42b2 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:25.961881 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-6f1d6993-1585-4cbe-a31a-668d491e42b2 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] [instance: f852a7a7-53cc-4042-8cbe-5b62c0d374a8] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:25.969522 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6f1d6993-1585-4cbe-a31a-668d491e42b2 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:25.970145 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6f1d6993-1585-4cbe-a31a-668d491e42b2 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:25.970649 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6f1d6993-1585-4cbe-a31a-668d491e42b2 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:25.971733 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6f1d6993-1585-4cbe-a31a-668d491e42b2 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:25.972346 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6f1d6993-1585-4cbe-a31a-668d491e42b2 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:25.972839 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6f1d6993-1585-4cbe-a31a-668d491e42b2 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:26.011587 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6f1d6993-1585-4cbe-a31a-668d491e42b2 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:26.012254 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6f1d6993-1585-4cbe-a31a-668d491e42b2 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:26.012809 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6f1d6993-1585-4cbe-a31a-668d491e42b2 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:26.013581 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.objects.instance [None req-6f1d6993-1585-4cbe-a31a-668d491e42b2 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lazy-loading 'fault' on Instance uuid f852a7a7-53cc-4042-8cbe-5b62c0d374a8 {{(pid=120704) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 13:02:26.027123 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-cb66beb1-f44b-4cd9-b353-ae55e746ef4e tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf155bc9925646f59e92f597782a8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c401f76027848f0980f470af73e4473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:26.038648 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-cb66beb1-f44b-4cd9-b353-ae55e746ef4e tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5" status: 200 len: 1319 microversion: 2.1 time: 0.204472 Aug 31 13:02:26.043898 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 209/436] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:25 2022] GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:26.050139 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-c12f07a0-8901-4584-b681-7536bb500029 req-98274274-a05f-4d39-9c90-d41eb4e3297c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec", "tag": "d45b253a-763d-4df7-b467-4cfc91042795"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:02:26.056135 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-6f1d6993-1585-4cbe-a31a-668d491e42b2 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28593deb5eb34bb0b7b2591e85f8f72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5880785dc2475c8268bfd75bc4e675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:26.059582 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-c12f07a0-8901-4584-b681-7536bb500029 req-98274274-a05f-4d39-9c90-d41eb4e3297c service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:26.060143 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-c12f07a0-8901-4584-b681-7536bb500029 req-98274274-a05f-4d39-9c90-d41eb4e3297c service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:26.060561 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-c12f07a0-8901-4584-b681-7536bb500029 req-98274274-a05f-4d39-9c90-d41eb4e3297c service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:26.065384 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-6f1d6993-1585-4cbe-a31a-668d491e42b2 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] 10.222.0.58 "GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8" status: 200 len: 1304 microversion: 2.1 time: 0.108356 Aug 31 13:02:26.066087 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 228/437] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:25 2022] GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8 => generated 1304 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:26.073550 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-c12f07a0-8901-4584-b681-7536bb500029 req-98274274-a05f-4d39-9c90-d41eb4e3297c service nova] Creating event network-changed:d45b253a-763d-4df7-b467-4cfc91042795 for instance dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec on hv-cinder-85442 Aug 31 13:02:26.078702 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-c12f07a0-8901-4584-b681-7536bb500029 req-98274274-a05f-4d39-9c90-d41eb4e3297c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033341 Aug 31 13:02:26.079306 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 210/438] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:02:27.059924 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-b8c5be5b-77e6-4993-9bd1-523e1ff2ef19 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:27.060644 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-b8c5be5b-77e6-4993-9bd1-523e1ff2ef19 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: a7538710-7904-40dc-afac-8d821d6331d5] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:27.068030 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b8c5be5b-77e6-4993-9bd1-523e1ff2ef19 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:27.068613 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b8c5be5b-77e6-4993-9bd1-523e1ff2ef19 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:27.069129 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b8c5be5b-77e6-4993-9bd1-523e1ff2ef19 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:27.069884 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b8c5be5b-77e6-4993-9bd1-523e1ff2ef19 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:27.070396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b8c5be5b-77e6-4993-9bd1-523e1ff2ef19 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:27.070987 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b8c5be5b-77e6-4993-9bd1-523e1ff2ef19 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:27.087580 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e3f8a588-464a-404c-8d20-7da65c1e62c7 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:27.088355 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e3f8a588-464a-404c-8d20-7da65c1e62c7 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] [instance: f852a7a7-53cc-4042-8cbe-5b62c0d374a8] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:27.095948 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e3f8a588-464a-404c-8d20-7da65c1e62c7 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:27.096432 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e3f8a588-464a-404c-8d20-7da65c1e62c7 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:27.096864 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e3f8a588-464a-404c-8d20-7da65c1e62c7 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:27.097562 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e3f8a588-464a-404c-8d20-7da65c1e62c7 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:27.098036 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e3f8a588-464a-404c-8d20-7da65c1e62c7 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:27.098453 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e3f8a588-464a-404c-8d20-7da65c1e62c7 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:27.135032 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e3f8a588-464a-404c-8d20-7da65c1e62c7 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:27.135777 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e3f8a588-464a-404c-8d20-7da65c1e62c7 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:27.136374 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e3f8a588-464a-404c-8d20-7da65c1e62c7 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:27.137015 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.objects.instance [None req-e3f8a588-464a-404c-8d20-7da65c1e62c7 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lazy-loading 'fault' on Instance uuid f852a7a7-53cc-4042-8cbe-5b62c0d374a8 {{(pid=120705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 13:02:27.200375 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e3f8a588-464a-404c-8d20-7da65c1e62c7 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28593deb5eb34bb0b7b2591e85f8f72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5880785dc2475c8268bfd75bc4e675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:27.208677 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e3f8a588-464a-404c-8d20-7da65c1e62c7 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] 10.222.0.58 "GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8" status: 200 len: 1304 microversion: 2.1 time: 0.125496 Aug 31 13:02:27.209370 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 211/439] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:27 2022] GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8 => generated 1304 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:27.231223 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-b8c5be5b-77e6-4993-9bd1-523e1ff2ef19 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf155bc9925646f59e92f597782a8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c401f76027848f0980f470af73e4473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:27.239499 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-b8c5be5b-77e6-4993-9bd1-523e1ff2ef19 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5" status: 200 len: 1319 microversion: 2.1 time: 0.183507 Aug 31 13:02:27.240265 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 229/440] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:27 2022] GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:28.232399 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-c40a75ec-f87f-44c6-8926-8d945e7eef36 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:28.233319 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-c40a75ec-f87f-44c6-8926-8d945e7eef36 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] [instance: f852a7a7-53cc-4042-8cbe-5b62c0d374a8] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:28.241899 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c40a75ec-f87f-44c6-8926-8d945e7eef36 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:28.242417 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c40a75ec-f87f-44c6-8926-8d945e7eef36 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:28.242853 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c40a75ec-f87f-44c6-8926-8d945e7eef36 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:28.243566 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c40a75ec-f87f-44c6-8926-8d945e7eef36 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:28.244088 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c40a75ec-f87f-44c6-8926-8d945e7eef36 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:28.244574 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c40a75ec-f87f-44c6-8926-8d945e7eef36 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:28.262185 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-c40a75ec-f87f-44c6-8926-8d945e7eef36 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] HTTP exception thrown: Instance f852a7a7-53cc-4042-8cbe-5b62c0d374a8 could not be found. Aug 31 13:02:28.262450 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-5f8f35a8-e371-4d44-820c-16cff9119293 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:28.264200 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-5f8f35a8-e371-4d44-820c-16cff9119293 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: a7538710-7904-40dc-afac-8d821d6331d5] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:28.264828 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-c40a75ec-f87f-44c6-8926-8d945e7eef36 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Request method failure captured: Aug 31 13:02:28.264828 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: request: GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8 HTTP/1.1 Aug 31 13:02:28.264828 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 31 13:02:28.264828 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 31 13:02:28.264828 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Connection: close Aug 31 13:02:28.264828 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 31 13:02:28.264828 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 31 13:02:28.264828 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Host: 10.222.0.58 Aug 31 13:02:28.264828 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 31 13:02:28.264828 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 31 13:02:28.264828 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjD1vDZm-67lPcr1NBxKxP46LasQBAjciEl1I6CzZGZ33FaALsyTv-g2Pups6WLiB403DC6GBYWRDQNzyacmfUjgNsUsbcM9BM6TLzSl_U0LdEje0FJJ3ftY4Wk9BjMYvHmeKbbO9bfPZx0_ENvgGfpUUvVQwFxLi4bJg9Ys3uiLpeapY Aug 31 13:02:28.264828 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 31 13:02:28.264828 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 31 13:02:28.264828 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 31 13:02:28.264828 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 31 13:02:28.264828 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 31 13:02:28.264828 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 31 13:02:28.264828 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Id: bd5880785dc2475c8268bfd75bc4e675 Aug 31 13:02:28.264828 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-VolumesNegativeTest-182938527 Aug 31 13:02:28.264828 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Role: member,reader Aug 31 13:02:28.264828 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Roles: member,reader Aug 31 13:02:28.266309 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bd5880785dc2475c8268bfd75bc4e675"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bd5880785dc2475c8268bfd75bc4e675"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bd5880785dc2475c8268bfd75bc4e675"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bd5880785dc2475c8268bfd75bc4e675"}]}] Aug 31 13:02:28.266309 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-VolumesNegativeTest-182938527 Aug 31 13:02:28.266309 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant-Id: bd5880785dc2475c8268bfd75bc4e675 Aug 31 13:02:28.266309 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-VolumesNegativeTest-182938527 Aug 31 13:02:28.266309 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User: tempest-VolumesNegativeTest-182938527-project Aug 31 13:02:28.266309 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 31 13:02:28.266309 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 31 13:02:28.266309 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Id: 28593deb5eb34bb0b7b2591e85f8f72d Aug 31 13:02:28.266309 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-VolumesNegativeTest-182938527-project Aug 31 13:02:28.266309 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: method: > Aug 31 13:02:28.266309 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: exception: Instance f852a7a7-53cc-4042-8cbe-5b62c0d374a8 could not be found. Aug 31 13:02:28.266309 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: action_args: {'id': 'f852a7a7-53cc-4042-8cbe-5b62c0d374a8'} Aug 31 13:02:28.267137 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:02:28.267137 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:02:28.267137 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 13:02:28.267137 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 13:02:28.267137 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 13:02:28.267137 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 13:02:28.267137 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 13:02:28.267137 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 13:02:28.267137 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 13:02:28.267137 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 13:02:28.267137 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f852a7a7-53cc-4042-8cbe-5b62c0d374a8 could not be found. Aug 31 13:02:28.267137 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:02:28.267137 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:02:28.267137 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:02:28.267137 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:02:28.267137 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:02:28.267137 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:02:28.267137 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:02:28.267137 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:02:28.267137 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:02:28.268383 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:02:28.268383 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 13:02:28.268383 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 13:02:28.268383 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 13:02:28.268383 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 13:02:28.268383 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 13:02:28.268383 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 13:02:28.268383 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f852a7a7-53cc-4042-8cbe-5b62c0d374a8 could not be found. Aug 31 13:02:28.268383 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:02:28.268383 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:02:28.268383 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:02:28.268383 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:02:28.268383 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:02:28.268383 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:02:28.268383 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:02:28.268383 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:02:28.268383 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f852a7a7-53cc-4042-8cbe-5b62c0d374a8 could not be found. Aug 31 13:02:28.268383 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:02:28.269575 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-c40a75ec-f87f-44c6-8926-8d945e7eef36 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] Returning 404 to user: Instance f852a7a7-53cc-4042-8cbe-5b62c0d374a8 could not be found. {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:02:28.269575 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-c40a75ec-f87f-44c6-8926-8d945e7eef36 tempest-VolumesNegativeTest-182938527 tempest-VolumesNegativeTest-182938527-project] 10.222.0.58 "GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8" status: 404 len: 111 microversion: 2.1 time: 0.038019 Aug 31 13:02:28.269575 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 212/441] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:28 2022] GET /compute/v2.1/servers/f852a7a7-53cc-4042-8cbe-5b62c0d374a8 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 13:02:28.281089 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5f8f35a8-e371-4d44-820c-16cff9119293 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:28.281676 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5f8f35a8-e371-4d44-820c-16cff9119293 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:28.282324 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5f8f35a8-e371-4d44-820c-16cff9119293 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:28.283383 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5f8f35a8-e371-4d44-820c-16cff9119293 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:28.284057 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5f8f35a8-e371-4d44-820c-16cff9119293 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:28.284704 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5f8f35a8-e371-4d44-820c-16cff9119293 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:28.434254 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-5f8f35a8-e371-4d44-820c-16cff9119293 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf155bc9925646f59e92f597782a8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c401f76027848f0980f470af73e4473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:28.442246 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-5f8f35a8-e371-4d44-820c-16cff9119293 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5" status: 200 len: 1509 microversion: 2.1 time: 0.185270 Aug 31 13:02:28.442836 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 230/442] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:28 2022] GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5 => generated 1509 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:02:54.813425 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-edfdc4ac-1a90-4fc6-8d84-a028187bef97 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:54.814283 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-edfdc4ac-1a90-4fc6-8d84-a028187bef97 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:54.818119 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=57 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:02:54.818781 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=57 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:02:54.824944 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-edfdc4ac-1a90-4fc6-8d84-a028187bef97 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:54.825429 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-edfdc4ac-1a90-4fc6-8d84-a028187bef97 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:54.825859 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-edfdc4ac-1a90-4fc6-8d84-a028187bef97 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:54.826539 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-edfdc4ac-1a90-4fc6-8d84-a028187bef97 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:54.826979 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-edfdc4ac-1a90-4fc6-8d84-a028187bef97 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:54.827411 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-edfdc4ac-1a90-4fc6-8d84-a028187bef97 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:54.851704 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-edfdc4ac-1a90-4fc6-8d84-a028187bef97 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf/ips" status: 200 len: 146 microversion: 2.1 time: 0.045065 Aug 31 13:02:54.852313 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 213/443] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 31 13:02:54 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf/ips => generated 146 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:02:59.139053 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-79af6904-f3bb-45e8-bc33-8f351f38359a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52d6a498-9f63-4726-af4b-04bc4407516f"}} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:02:59.141418 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-79af6904-f3bb-45e8-bc33-8f351f38359a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:59.144190 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 13:02:59.144345 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Wed Aug 31 13:02:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf/os-volume_attachments (ip 10.222.0.58) !!! Aug 31 13:02:59.145482 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:02:59.146162 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell1:SELECT=44 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:02:59.155092 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-79af6904-f3bb-45e8-bc33-8f351f38359a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:59.155571 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-79af6904-f3bb-45e8-bc33-8f351f38359a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:59.156039 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-79af6904-f3bb-45e8-bc33-8f351f38359a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:59.156713 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-79af6904-f3bb-45e8-bc33-8f351f38359a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:59.157160 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-79af6904-f3bb-45e8-bc33-8f351f38359a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:59.157577 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-79af6904-f3bb-45e8-bc33-8f351f38359a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:00.067225 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-79af6904-f3bb-45e8-bc33-8f351f38359a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "POST /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.932431 Aug 31 13:03:00.067877 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 231/444] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 31 13:02:59 2022] POST /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf/os-volume_attachments => generated 194 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:03:10.258509 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-af159d0d-1f9c-4121-a0a2-493636cc86ba tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d18487e-647e-4607-8538-1051f5161a67", "device": "/dev/sdb"}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:03:10.261501 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-af159d0d-1f9c-4121-a0a2-493636cc86ba tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: a7538710-7904-40dc-afac-8d821d6331d5] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:03:10.263464 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=2 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:03:10.264201 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=4 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:03:10.269804 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-af159d0d-1f9c-4121-a0a2-493636cc86ba tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:10.270277 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-af159d0d-1f9c-4121-a0a2-493636cc86ba tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:10.270699 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-af159d0d-1f9c-4121-a0a2-493636cc86ba tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:10.271377 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-af159d0d-1f9c-4121-a0a2-493636cc86ba tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:10.271833 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-af159d0d-1f9c-4121-a0a2-493636cc86ba tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:10.272247 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-af159d0d-1f9c-4121-a0a2-493636cc86ba tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:10.588842 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-af159d0d-1f9c-4121-a0a2-493636cc86ba tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "POST /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.334148 Aug 31 13:03:10.589506 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 214/445] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 31 13:03:10 2022] POST /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5/os-volume_attachments => generated 194 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:03:12.986056 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_api:SELECT=2 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:03:12.986829 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:03:12.991276 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-b8d6ba5f-f06b-4238-94f9-1ea27ac987cc tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:03:12.999204 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b8d6ba5f-f06b-4238-94f9-1ea27ac987cc tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:12.999609 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b8d6ba5f-f06b-4238-94f9-1ea27ac987cc tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:13.000089 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b8d6ba5f-f06b-4238-94f9-1ea27ac987cc tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:13.073767 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-b8d6ba5f-f06b-4238-94f9-1ea27ac987cc tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Going to try to stop instance {{(pid=120704) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 13:03:13.121253 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-b8d6ba5f-f06b-4238-94f9-1ea27ac987cc tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "POST /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf/action" status: 202 len: 0 microversion: 2.1 time: 0.136455 Aug 31 13:03:13.121860 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 232/446] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 31 13:03:12 2022] POST /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:03:13.130937 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-a0899575-c1d1-4fe8-9b1d-dfb06c173337 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:03:13.131629 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-a0899575-c1d1-4fe8-9b1d-dfb06c173337 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:03:13.138496 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a0899575-c1d1-4fe8-9b1d-dfb06c173337 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:13.138968 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a0899575-c1d1-4fe8-9b1d-dfb06c173337 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:13.139365 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a0899575-c1d1-4fe8-9b1d-dfb06c173337 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:13.140088 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a0899575-c1d1-4fe8-9b1d-dfb06c173337 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:13.140526 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a0899575-c1d1-4fe8-9b1d-dfb06c173337 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:13.140943 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a0899575-c1d1-4fe8-9b1d-dfb06c173337 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:13.278710 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-a0899575-c1d1-4fe8-9b1d-dfb06c173337 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:03:13.288515 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-a0899575-c1d1-4fe8-9b1d-dfb06c173337 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1724 microversion: 2.1 time: 0.161770 Aug 31 13:03:13.289094 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 215/447] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:03:13 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:03:14.323023 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-9f1c8f33-bbd2-462d-a18d-81d5976a07ac tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:03:14.323955 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-9f1c8f33-bbd2-462d-a18d-81d5976a07ac tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:03:14.330580 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9f1c8f33-bbd2-462d-a18d-81d5976a07ac tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:14.331052 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9f1c8f33-bbd2-462d-a18d-81d5976a07ac tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:14.331482 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9f1c8f33-bbd2-462d-a18d-81d5976a07ac tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:14.332207 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9f1c8f33-bbd2-462d-a18d-81d5976a07ac tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:14.332651 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9f1c8f33-bbd2-462d-a18d-81d5976a07ac tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:14.333066 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9f1c8f33-bbd2-462d-a18d-81d5976a07ac tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:14.480347 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-9f1c8f33-bbd2-462d-a18d-81d5976a07ac tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:03:14.489115 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-9f1c8f33-bbd2-462d-a18d-81d5976a07ac tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1724 microversion: 2.1 time: 0.173993 Aug 31 13:03:14.489691 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 233/448] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:03:14 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:03:15.510750 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-0cef88b7-747a-461b-9823-3e3c7fc53d3d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:03:15.511372 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-0cef88b7-747a-461b-9823-3e3c7fc53d3d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:03:15.518523 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0cef88b7-747a-461b-9823-3e3c7fc53d3d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:15.519035 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0cef88b7-747a-461b-9823-3e3c7fc53d3d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:15.519492 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0cef88b7-747a-461b-9823-3e3c7fc53d3d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:15.520224 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0cef88b7-747a-461b-9823-3e3c7fc53d3d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:15.520705 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0cef88b7-747a-461b-9823-3e3c7fc53d3d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:15.521123 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0cef88b7-747a-461b-9823-3e3c7fc53d3d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:15.657433 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-0cef88b7-747a-461b-9823-3e3c7fc53d3d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:03:15.666197 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-0cef88b7-747a-461b-9823-3e3c7fc53d3d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1724 microversion: 2.1 time: 0.159918 Aug 31 13:03:15.666767 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 216/449] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:03:15 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:03:16.692058 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-2de697e6-de2b-477a-99a3-d23e973ccdcd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:03:16.692873 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-2de697e6-de2b-477a-99a3-d23e973ccdcd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:03:16.706122 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2de697e6-de2b-477a-99a3-d23e973ccdcd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:16.706941 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2de697e6-de2b-477a-99a3-d23e973ccdcd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:16.707660 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2de697e6-de2b-477a-99a3-d23e973ccdcd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:16.709296 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2de697e6-de2b-477a-99a3-d23e973ccdcd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:16.710646 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2de697e6-de2b-477a-99a3-d23e973ccdcd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:16.715292 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2de697e6-de2b-477a-99a3-d23e973ccdcd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:16.850623 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-2de697e6-de2b-477a-99a3-d23e973ccdcd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:03:16.859235 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-2de697e6-de2b-477a-99a3-d23e973ccdcd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1724 microversion: 2.1 time: 0.173827 Aug 31 13:03:16.859838 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 234/450] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:03:16 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:03:17.885338 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-63efeea2-c592-400e-9617-b0bda482dbcf tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:03:17.886279 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-63efeea2-c592-400e-9617-b0bda482dbcf tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:03:17.893798 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-63efeea2-c592-400e-9617-b0bda482dbcf tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:17.894278 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-63efeea2-c592-400e-9617-b0bda482dbcf tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:17.894683 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-63efeea2-c592-400e-9617-b0bda482dbcf tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:17.895373 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-63efeea2-c592-400e-9617-b0bda482dbcf tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:17.895851 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-63efeea2-c592-400e-9617-b0bda482dbcf tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:17.896276 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-63efeea2-c592-400e-9617-b0bda482dbcf tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:18.037042 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-63efeea2-c592-400e-9617-b0bda482dbcf tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:03:18.045535 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-63efeea2-c592-400e-9617-b0bda482dbcf tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1724 microversion: 2.1 time: 0.166763 Aug 31 13:03:18.046095 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 217/451] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:03:17 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:03:19.071715 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-265c308b-3e9e-4dec-ad83-ae00d5431c56 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:03:19.072804 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-265c308b-3e9e-4dec-ad83-ae00d5431c56 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:03:19.083668 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-265c308b-3e9e-4dec-ad83-ae00d5431c56 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:19.084524 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-265c308b-3e9e-4dec-ad83-ae00d5431c56 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:19.085246 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-265c308b-3e9e-4dec-ad83-ae00d5431c56 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:19.086383 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-265c308b-3e9e-4dec-ad83-ae00d5431c56 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:19.087131 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-265c308b-3e9e-4dec-ad83-ae00d5431c56 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:19.087874 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-265c308b-3e9e-4dec-ad83-ae00d5431c56 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:19.220086 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-265c308b-3e9e-4dec-ad83-ae00d5431c56 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:03:19.228825 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-265c308b-3e9e-4dec-ad83-ae00d5431c56 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1724 microversion: 2.1 time: 0.163791 Aug 31 13:03:19.229505 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 235/452] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:03:19 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:03:20.250772 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-1e82dd8e-f86f-4427-880b-f81c61fe6abf tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:03:20.251411 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-1e82dd8e-f86f-4427-880b-f81c61fe6abf tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:03:20.258705 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1e82dd8e-f86f-4427-880b-f81c61fe6abf tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:20.259203 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1e82dd8e-f86f-4427-880b-f81c61fe6abf tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:20.259623 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1e82dd8e-f86f-4427-880b-f81c61fe6abf tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:20.260382 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1e82dd8e-f86f-4427-880b-f81c61fe6abf tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:20.260824 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1e82dd8e-f86f-4427-880b-f81c61fe6abf tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:20.261235 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1e82dd8e-f86f-4427-880b-f81c61fe6abf tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:20.395129 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-1e82dd8e-f86f-4427-880b-f81c61fe6abf tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:03:20.403704 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-1e82dd8e-f86f-4427-880b-f81c61fe6abf tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1724 microversion: 2.1 time: 0.156843 Aug 31 13:03:20.404817 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 218/453] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:03:20 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:03:21.430647 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-c41a36cd-ca7f-4587-b242-4647c26647f4 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:03:21.431636 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-c41a36cd-ca7f-4587-b242-4647c26647f4 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:03:21.439473 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c41a36cd-ca7f-4587-b242-4647c26647f4 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:21.439992 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c41a36cd-ca7f-4587-b242-4647c26647f4 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:21.440419 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c41a36cd-ca7f-4587-b242-4647c26647f4 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:21.441112 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c41a36cd-ca7f-4587-b242-4647c26647f4 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:21.441561 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c41a36cd-ca7f-4587-b242-4647c26647f4 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:21.441964 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c41a36cd-ca7f-4587-b242-4647c26647f4 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:21.577095 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-c41a36cd-ca7f-4587-b242-4647c26647f4 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:03:21.585791 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-c41a36cd-ca7f-4587-b242-4647c26647f4 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1724 microversion: 2.1 time: 0.161709 Aug 31 13:03:21.586407 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 236/454] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:03:21 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:03:22.610636 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-297d9c92-8631-439a-80a7-4905723dce2a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:03:22.611197 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-297d9c92-8631-439a-80a7-4905723dce2a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:03:22.617924 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-297d9c92-8631-439a-80a7-4905723dce2a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:22.618418 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-297d9c92-8631-439a-80a7-4905723dce2a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:22.618840 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-297d9c92-8631-439a-80a7-4905723dce2a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:22.619533 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-297d9c92-8631-439a-80a7-4905723dce2a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:22.620020 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-297d9c92-8631-439a-80a7-4905723dce2a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:22.620442 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-297d9c92-8631-439a-80a7-4905723dce2a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:22.763034 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-297d9c92-8631-439a-80a7-4905723dce2a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:03:22.773409 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-297d9c92-8631-439a-80a7-4905723dce2a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1724 microversion: 2.1 time: 0.167078 Aug 31 13:03:22.776092 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 219/455] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:03:22 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:03:23.805116 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-47116a9b-eccd-4355-ad1e-b7612ef8bc72 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:03:23.806020 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-47116a9b-eccd-4355-ad1e-b7612ef8bc72 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:03:23.817198 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-47116a9b-eccd-4355-ad1e-b7612ef8bc72 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:23.818002 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-47116a9b-eccd-4355-ad1e-b7612ef8bc72 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:23.818716 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-47116a9b-eccd-4355-ad1e-b7612ef8bc72 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:23.819924 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-47116a9b-eccd-4355-ad1e-b7612ef8bc72 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:23.820621 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-47116a9b-eccd-4355-ad1e-b7612ef8bc72 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:23.821318 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-47116a9b-eccd-4355-ad1e-b7612ef8bc72 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:23.959424 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-47116a9b-eccd-4355-ad1e-b7612ef8bc72 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:03:23.968689 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-47116a9b-eccd-4355-ad1e-b7612ef8bc72 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1724 microversion: 2.1 time: 0.169599 Aug 31 13:03:23.969277 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 237/456] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:03:23 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:03:24.993728 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e709a64b-393c-4358-a88f-b5e6607b76fa tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:03:24.994453 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e709a64b-393c-4358-a88f-b5e6607b76fa tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:03:25.003234 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e709a64b-393c-4358-a88f-b5e6607b76fa tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:25.003702 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e709a64b-393c-4358-a88f-b5e6607b76fa tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:25.004169 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e709a64b-393c-4358-a88f-b5e6607b76fa tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:25.004857 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e709a64b-393c-4358-a88f-b5e6607b76fa tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:25.005299 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e709a64b-393c-4358-a88f-b5e6607b76fa tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:25.005727 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e709a64b-393c-4358-a88f-b5e6607b76fa tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:25.143281 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e709a64b-393c-4358-a88f-b5e6607b76fa tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:03:25.152230 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e709a64b-393c-4358-a88f-b5e6607b76fa tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1724 microversion: 2.1 time: 0.164984 Aug 31 13:03:25.152814 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 220/457] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:03:24 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:03:26.179294 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-7d8553d1-c10d-4e2c-8222-6a5b146ab8ed tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:03:26.180366 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-7d8553d1-c10d-4e2c-8222-6a5b146ab8ed tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:03:26.191540 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7d8553d1-c10d-4e2c-8222-6a5b146ab8ed tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:26.192393 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7d8553d1-c10d-4e2c-8222-6a5b146ab8ed tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:26.193102 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7d8553d1-c10d-4e2c-8222-6a5b146ab8ed tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:26.194215 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7d8553d1-c10d-4e2c-8222-6a5b146ab8ed tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:26.195065 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7d8553d1-c10d-4e2c-8222-6a5b146ab8ed tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:26.195642 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7d8553d1-c10d-4e2c-8222-6a5b146ab8ed tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:26.334805 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-7d8553d1-c10d-4e2c-8222-6a5b146ab8ed tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:03:26.343165 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-7d8553d1-c10d-4e2c-8222-6a5b146ab8ed tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1724 microversion: 2.1 time: 0.170360 Aug 31 13:03:26.343750 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 238/458] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:03:26 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:03:27.365962 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-6d446166-179d-4d04-b447-e9973c77c391 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:03:27.366583 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-6d446166-179d-4d04-b447-e9973c77c391 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:03:27.374039 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6d446166-179d-4d04-b447-e9973c77c391 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:27.374511 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6d446166-179d-4d04-b447-e9973c77c391 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:27.374934 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6d446166-179d-4d04-b447-e9973c77c391 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:27.375612 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6d446166-179d-4d04-b447-e9973c77c391 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:27.376085 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6d446166-179d-4d04-b447-e9973c77c391 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:27.376492 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6d446166-179d-4d04-b447-e9973c77c391 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:27.524346 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-6d446166-179d-4d04-b447-e9973c77c391 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:03:27.534659 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-6d446166-179d-4d04-b447-e9973c77c391 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1724 microversion: 2.1 time: 0.172574 Aug 31 13:03:27.535253 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 221/459] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:03:27 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:03:28.560925 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-fe4870a6-d3ac-46d4-a9c2-3eeda106c029 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:03:28.561979 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-fe4870a6-d3ac-46d4-a9c2-3eeda106c029 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:03:28.569956 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fe4870a6-d3ac-46d4-a9c2-3eeda106c029 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:28.570444 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fe4870a6-d3ac-46d4-a9c2-3eeda106c029 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:28.570882 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fe4870a6-d3ac-46d4-a9c2-3eeda106c029 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:28.571573 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fe4870a6-d3ac-46d4-a9c2-3eeda106c029 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:28.572071 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fe4870a6-d3ac-46d4-a9c2-3eeda106c029 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:28.572495 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fe4870a6-d3ac-46d4-a9c2-3eeda106c029 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:28.706705 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-fe4870a6-d3ac-46d4-a9c2-3eeda106c029 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:03:28.719638 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-fe4870a6-d3ac-46d4-a9c2-3eeda106c029 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1724 microversion: 2.1 time: 0.165041 Aug 31 13:03:28.720605 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 239/460] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:03:28 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:03:29.752268 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-db0919fc-9b56-44c8-af5b-3ed1b777271a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:03:29.753274 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-db0919fc-9b56-44c8-af5b-3ed1b777271a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:03:29.764506 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-db0919fc-9b56-44c8-af5b-3ed1b777271a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:29.765474 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-db0919fc-9b56-44c8-af5b-3ed1b777271a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:29.766181 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-db0919fc-9b56-44c8-af5b-3ed1b777271a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:29.767340 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-db0919fc-9b56-44c8-af5b-3ed1b777271a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:29.768143 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-db0919fc-9b56-44c8-af5b-3ed1b777271a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:29.768822 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-db0919fc-9b56-44c8-af5b-3ed1b777271a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:29.911753 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-db0919fc-9b56-44c8-af5b-3ed1b777271a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:03:29.920586 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-db0919fc-9b56-44c8-af5b-3ed1b777271a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1724 microversion: 2.1 time: 0.174839 Aug 31 13:03:29.921125 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 222/461] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:03:29 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:03:30.946873 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-371a33d8-2940-4f6c-a1eb-42e975573e45 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:03:30.947485 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-371a33d8-2940-4f6c-a1eb-42e975573e45 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:03:30.954545 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-371a33d8-2940-4f6c-a1eb-42e975573e45 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:30.955028 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-371a33d8-2940-4f6c-a1eb-42e975573e45 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:30.955461 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-371a33d8-2940-4f6c-a1eb-42e975573e45 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:30.956209 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-371a33d8-2940-4f6c-a1eb-42e975573e45 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:30.956659 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-371a33d8-2940-4f6c-a1eb-42e975573e45 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:30.957079 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-371a33d8-2940-4f6c-a1eb-42e975573e45 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:31.090930 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-371a33d8-2940-4f6c-a1eb-42e975573e45 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:03:31.103223 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-371a33d8-2940-4f6c-a1eb-42e975573e45 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1724 microversion: 2.1 time: 0.160718 Aug 31 13:03:31.104003 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 240/462] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:03:30 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:03:32.129277 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-1e8ae30b-7e94-4d5c-a1a1-e452dca030e8 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:03:32.129872 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-1e8ae30b-7e94-4d5c-a1a1-e452dca030e8 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:03:32.136576 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1e8ae30b-7e94-4d5c-a1a1-e452dca030e8 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:32.137045 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1e8ae30b-7e94-4d5c-a1a1-e452dca030e8 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:32.137480 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1e8ae30b-7e94-4d5c-a1a1-e452dca030e8 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:32.138160 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1e8ae30b-7e94-4d5c-a1a1-e452dca030e8 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:32.138592 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1e8ae30b-7e94-4d5c-a1a1-e452dca030e8 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:32.139015 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1e8ae30b-7e94-4d5c-a1a1-e452dca030e8 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:32.282661 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-1e8ae30b-7e94-4d5c-a1a1-e452dca030e8 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:03:32.291473 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-1e8ae30b-7e94-4d5c-a1a1-e452dca030e8 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1724 microversion: 2.1 time: 0.166117 Aug 31 13:03:32.292043 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 223/463] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:03:32 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:03:33.324002 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-bd0f22d1-c088-4385-8ebb-a2c689a590e3 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:03:33.324990 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-bd0f22d1-c088-4385-8ebb-a2c689a590e3 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:03:33.335058 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bd0f22d1-c088-4385-8ebb-a2c689a590e3 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:33.335532 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bd0f22d1-c088-4385-8ebb-a2c689a590e3 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:33.335996 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bd0f22d1-c088-4385-8ebb-a2c689a590e3 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:33.336681 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bd0f22d1-c088-4385-8ebb-a2c689a590e3 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:33.337130 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bd0f22d1-c088-4385-8ebb-a2c689a590e3 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:33.337630 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bd0f22d1-c088-4385-8ebb-a2c689a590e3 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:33.475512 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-bd0f22d1-c088-4385-8ebb-a2c689a590e3 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:03:33.487791 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-bd0f22d1-c088-4385-8ebb-a2c689a590e3 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1724 microversion: 2.1 time: 0.169980 Aug 31 13:03:33.488581 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 241/464] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:03:33 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:03:34.512735 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-fd40e51e-d6bf-470f-95e7-f2a8e2f9de61 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:03:34.513861 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-fd40e51e-d6bf-470f-95e7-f2a8e2f9de61 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:03:34.524722 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fd40e51e-d6bf-470f-95e7-f2a8e2f9de61 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:34.525470 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fd40e51e-d6bf-470f-95e7-f2a8e2f9de61 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:34.526178 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fd40e51e-d6bf-470f-95e7-f2a8e2f9de61 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:34.527301 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fd40e51e-d6bf-470f-95e7-f2a8e2f9de61 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:34.528083 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fd40e51e-d6bf-470f-95e7-f2a8e2f9de61 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:34.528774 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fd40e51e-d6bf-470f-95e7-f2a8e2f9de61 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:34.665119 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-fd40e51e-d6bf-470f-95e7-f2a8e2f9de61 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:03:34.673889 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-fd40e51e-d6bf-470f-95e7-f2a8e2f9de61 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1724 microversion: 2.1 time: 0.167691 Aug 31 13:03:34.674465 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 224/465] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:03:34 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:03:35.698561 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-22b482d8-4654-4e59-ad15-2c3457d5ce13 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:03:35.699273 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-22b482d8-4654-4e59-ad15-2c3457d5ce13 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:03:35.709491 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-22b482d8-4654-4e59-ad15-2c3457d5ce13 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:35.709958 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-22b482d8-4654-4e59-ad15-2c3457d5ce13 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:35.710381 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-22b482d8-4654-4e59-ad15-2c3457d5ce13 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:35.711055 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-22b482d8-4654-4e59-ad15-2c3457d5ce13 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:35.711494 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-22b482d8-4654-4e59-ad15-2c3457d5ce13 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:35.711932 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-22b482d8-4654-4e59-ad15-2c3457d5ce13 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:36.060425 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-22b482d8-4654-4e59-ad15-2c3457d5ce13 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:03:36.071957 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-22b482d8-4654-4e59-ad15-2c3457d5ce13 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1724 microversion: 2.1 time: 0.380226 Aug 31 13:03:36.072541 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 242/466] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:03:35 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1724 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:03:37.093482 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-c7f1a32a-4631-44f6-802a-1be8b23bb3c1 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:03:37.094043 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-c7f1a32a-4631-44f6-802a-1be8b23bb3c1 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:03:37.101203 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c7f1a32a-4631-44f6-802a-1be8b23bb3c1 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:37.101679 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c7f1a32a-4631-44f6-802a-1be8b23bb3c1 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:37.102112 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c7f1a32a-4631-44f6-802a-1be8b23bb3c1 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:37.102826 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c7f1a32a-4631-44f6-802a-1be8b23bb3c1 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:37.103353 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c7f1a32a-4631-44f6-802a-1be8b23bb3c1 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:37.103776 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c7f1a32a-4631-44f6-802a-1be8b23bb3c1 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:37.245146 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-c7f1a32a-4631-44f6-802a-1be8b23bb3c1 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:03:37.253467 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-c7f1a32a-4631-44f6-802a-1be8b23bb3c1 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1724 microversion: 2.1 time: 0.164047 Aug 31 13:03:37.254039 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 225/467] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:03:37 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:03:38.274817 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-56d4d1c9-47fb-496f-a8cd-cf196d477752 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:03:38.275476 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-56d4d1c9-47fb-496f-a8cd-cf196d477752 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:03:38.282066 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-56d4d1c9-47fb-496f-a8cd-cf196d477752 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:38.282546 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-56d4d1c9-47fb-496f-a8cd-cf196d477752 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:38.282976 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-56d4d1c9-47fb-496f-a8cd-cf196d477752 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:38.283660 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-56d4d1c9-47fb-496f-a8cd-cf196d477752 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:38.284133 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-56d4d1c9-47fb-496f-a8cd-cf196d477752 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:38.284551 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-56d4d1c9-47fb-496f-a8cd-cf196d477752 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:38.430723 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-56d4d1c9-47fb-496f-a8cd-cf196d477752 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:03:38.440054 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-56d4d1c9-47fb-496f-a8cd-cf196d477752 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1701 microversion: 2.1 time: 0.169114 Aug 31 13:03:38.440626 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 243/468] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:03:38 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1701 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:03:38.460567 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-d330e638-9c34-4113-903f-68664faa142a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:03:38.467196 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d330e638-9c34-4113-903f-68664faa142a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:38.467680 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d330e638-9c34-4113-903f-68664faa142a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:38.468133 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d330e638-9c34-4113-903f-68664faa142a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:38.531885 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-d330e638-9c34-4113-903f-68664faa142a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Going to try to start instance {{(pid=120705) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 13:03:38.581475 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-d330e638-9c34-4113-903f-68664faa142a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "POST /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf/action" status: 202 len: 0 microversion: 2.1 time: 0.124595 Aug 31 13:03:38.582663 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 226/469] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 31 13:03:38 2022] POST /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:03:38.591369 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-2996b4d5-d7bb-45f8-a23a-e455aa68539a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:03:38.592164 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-2996b4d5-d7bb-45f8-a23a-e455aa68539a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:03:38.598883 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2996b4d5-d7bb-45f8-a23a-e455aa68539a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:38.599570 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2996b4d5-d7bb-45f8-a23a-e455aa68539a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:38.600184 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2996b4d5-d7bb-45f8-a23a-e455aa68539a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:38.601743 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2996b4d5-d7bb-45f8-a23a-e455aa68539a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:38.602331 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2996b4d5-d7bb-45f8-a23a-e455aa68539a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:38.602816 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2996b4d5-d7bb-45f8-a23a-e455aa68539a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:38.741606 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-2996b4d5-d7bb-45f8-a23a-e455aa68539a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:03:38.751393 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-2996b4d5-d7bb-45f8-a23a-e455aa68539a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1710 microversion: 2.1 time: 0.163621 Aug 31 13:03:38.752254 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 244/470] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:03:38 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1710 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:03:39.778852 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-cd55adb8-699f-4b85-aa2f-429386a9e1e3 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:03:39.779876 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-cd55adb8-699f-4b85-aa2f-429386a9e1e3 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:03:39.789890 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cd55adb8-699f-4b85-aa2f-429386a9e1e3 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:39.790364 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cd55adb8-699f-4b85-aa2f-429386a9e1e3 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:39.790789 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cd55adb8-699f-4b85-aa2f-429386a9e1e3 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:39.791470 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cd55adb8-699f-4b85-aa2f-429386a9e1e3 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:39.791947 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cd55adb8-699f-4b85-aa2f-429386a9e1e3 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:39.792439 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cd55adb8-699f-4b85-aa2f-429386a9e1e3 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:39.929292 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-cd55adb8-699f-4b85-aa2f-429386a9e1e3 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:03:39.938008 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-cd55adb8-699f-4b85-aa2f-429386a9e1e3 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1710 microversion: 2.1 time: 0.166712 Aug 31 13:03:39.938579 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 227/471] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:03:39 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1710 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:03:40.961928 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-74c8810f-f0ff-4306-92c1-363a884323ea tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:03:40.962501 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-74c8810f-f0ff-4306-92c1-363a884323ea tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:03:40.971265 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-74c8810f-f0ff-4306-92c1-363a884323ea tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:40.972090 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-74c8810f-f0ff-4306-92c1-363a884323ea tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:40.972711 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-74c8810f-f0ff-4306-92c1-363a884323ea tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:40.973796 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-74c8810f-f0ff-4306-92c1-363a884323ea tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:40.974293 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-74c8810f-f0ff-4306-92c1-363a884323ea tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:40.974744 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-74c8810f-f0ff-4306-92c1-363a884323ea tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:41.113140 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-74c8810f-f0ff-4306-92c1-363a884323ea tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:03:41.121697 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-74c8810f-f0ff-4306-92c1-363a884323ea tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1714 microversion: 2.1 time: 0.165262 Aug 31 13:03:41.122308 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 245/472] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:03:40 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1714 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:03:41.797696 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-c2ce6210-e695-4db9-a1b3-e2be24586355 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:03:41.798202 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-c2ce6210-e695-4db9-a1b3-e2be24586355 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: a7538710-7904-40dc-afac-8d821d6331d5] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:03:41.800350 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=29 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:03:41.806322 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c2ce6210-e695-4db9-a1b3-e2be24586355 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:41.806792 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c2ce6210-e695-4db9-a1b3-e2be24586355 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:41.807212 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c2ce6210-e695-4db9-a1b3-e2be24586355 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:41.807913 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c2ce6210-e695-4db9-a1b3-e2be24586355 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:41.808352 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c2ce6210-e695-4db9-a1b3-e2be24586355 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:41.808761 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c2ce6210-e695-4db9-a1b3-e2be24586355 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:41.811181 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:03:41.934002 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.objects.instance [None req-c2ce6210-e695-4db9-a1b3-e2be24586355 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lazy-loading 'services' on Instance uuid a7538710-7904-40dc-afac-8d821d6331d5 {{(pid=120705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 13:03:42.058099 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-c2ce6210-e695-4db9-a1b3-e2be24586355 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5/os-volume_attachments/6d18487e-647e-4607-8538-1051f5161a67" status: 202 len: 0 microversion: 2.1 time: 0.264231 Aug 31 13:03:42.058868 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 228/473] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 31 13:03:41 2022] DELETE /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5/os-volume_attachments/6d18487e-647e-4607-8538-1051f5161a67 => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:03:44.264875 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-d4ee31e0-a56a-4bfa-b648-1ba69d034888 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:03:44.265396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-d4ee31e0-a56a-4bfa-b648-1ba69d034888 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: a7538710-7904-40dc-afac-8d821d6331d5] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:03:44.268279 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_api:SELECT=29 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:03:44.276253 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d4ee31e0-a56a-4bfa-b648-1ba69d034888 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:44.276859 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d4ee31e0-a56a-4bfa-b648-1ba69d034888 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:44.277444 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d4ee31e0-a56a-4bfa-b648-1ba69d034888 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:44.278445 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d4ee31e0-a56a-4bfa-b648-1ba69d034888 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:44.279045 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d4ee31e0-a56a-4bfa-b648-1ba69d034888 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:44.279629 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d4ee31e0-a56a-4bfa-b648-1ba69d034888 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:44.283650 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:03:44.308905 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-d4ee31e0-a56a-4bfa-b648-1ba69d034888 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: a7538710-7904-40dc-afac-8d821d6331d5] Going to try to terminate instance {{(pid=120704) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 13:03:44.388037 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-d4ee31e0-a56a-4bfa-b648-1ba69d034888 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5" status: 204 len: 0 microversion: 2.1 time: 0.129630 Aug 31 13:03:44.388801 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 246/474] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 31 13:03:44 2022] DELETE /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:03:44.398305 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-fcc70d06-4650-44f5-8c25-4dbb2dddc46a tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:03:44.399228 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-fcc70d06-4650-44f5-8c25-4dbb2dddc46a tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: a7538710-7904-40dc-afac-8d821d6331d5] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:03:44.406264 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fcc70d06-4650-44f5-8c25-4dbb2dddc46a tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:44.406855 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fcc70d06-4650-44f5-8c25-4dbb2dddc46a tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:44.407347 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fcc70d06-4650-44f5-8c25-4dbb2dddc46a tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:44.408142 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fcc70d06-4650-44f5-8c25-4dbb2dddc46a tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:44.408632 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fcc70d06-4650-44f5-8c25-4dbb2dddc46a tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:44.409232 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fcc70d06-4650-44f5-8c25-4dbb2dddc46a tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:44.539215 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-fcc70d06-4650-44f5-8c25-4dbb2dddc46a tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf155bc9925646f59e92f597782a8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c401f76027848f0980f470af73e4473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:03:44.547087 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-fcc70d06-4650-44f5-8c25-4dbb2dddc46a tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5" status: 200 len: 1515 microversion: 2.1 time: 0.153696 Aug 31 13:03:44.547648 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 229/475] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:03:44 2022] GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:03:45.573243 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-8c6cced4-25b8-4580-b2af-1d1d53ea0d63 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:03:45.574394 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-8c6cced4-25b8-4580-b2af-1d1d53ea0d63 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: a7538710-7904-40dc-afac-8d821d6331d5] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:03:45.584637 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8c6cced4-25b8-4580-b2af-1d1d53ea0d63 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:45.585122 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8c6cced4-25b8-4580-b2af-1d1d53ea0d63 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:45.585552 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8c6cced4-25b8-4580-b2af-1d1d53ea0d63 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:45.586239 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8c6cced4-25b8-4580-b2af-1d1d53ea0d63 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:45.586688 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8c6cced4-25b8-4580-b2af-1d1d53ea0d63 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:45.587104 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8c6cced4-25b8-4580-b2af-1d1d53ea0d63 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:45.726628 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-8c6cced4-25b8-4580-b2af-1d1d53ea0d63 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf155bc9925646f59e92f597782a8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c401f76027848f0980f470af73e4473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:03:45.738272 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-8c6cced4-25b8-4580-b2af-1d1d53ea0d63 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5" status: 200 len: 1515 microversion: 2.1 time: 0.171991 Aug 31 13:03:45.739061 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 247/476] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:03:45 2022] GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5 => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:03:46.763432 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-4a12eaef-84f7-4921-84e8-dd221870a113 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:03:46.764721 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-4a12eaef-84f7-4921-84e8-dd221870a113 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: a7538710-7904-40dc-afac-8d821d6331d5] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:03:46.774336 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4a12eaef-84f7-4921-84e8-dd221870a113 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:46.774804 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4a12eaef-84f7-4921-84e8-dd221870a113 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:46.775229 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4a12eaef-84f7-4921-84e8-dd221870a113 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:46.775944 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4a12eaef-84f7-4921-84e8-dd221870a113 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:46.776378 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4a12eaef-84f7-4921-84e8-dd221870a113 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:46.776787 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4a12eaef-84f7-4921-84e8-dd221870a113 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:46.907570 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-4a12eaef-84f7-4921-84e8-dd221870a113 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf155bc9925646f59e92f597782a8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c401f76027848f0980f470af73e4473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:03:46.916588 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-4a12eaef-84f7-4921-84e8-dd221870a113 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5" status: 200 len: 1515 microversion: 2.1 time: 0.159579 Aug 31 13:03:46.917151 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 230/477] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:03:46 2022] GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:03:47.840881 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-d418ad6f-2e5d-4701-9738-e57d425852d5 req-75848257-2c52-4e07-99d1-503660b6b828 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7538710-7904-40dc-afac-8d821d6331d5", "name": "network-vif-deleted", "tag": "9ea0da77-0025-427d-9a88-7cd21356e351"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:03:47.851187 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-d418ad6f-2e5d-4701-9738-e57d425852d5 req-75848257-2c52-4e07-99d1-503660b6b828 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:47.851658 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-d418ad6f-2e5d-4701-9738-e57d425852d5 req-75848257-2c52-4e07-99d1-503660b6b828 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:47.852193 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-d418ad6f-2e5d-4701-9738-e57d425852d5 req-75848257-2c52-4e07-99d1-503660b6b828 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:47.863268 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-d418ad6f-2e5d-4701-9738-e57d425852d5 req-75848257-2c52-4e07-99d1-503660b6b828 service nova] Creating event network-vif-deleted:9ea0da77-0025-427d-9a88-7cd21356e351 for instance a7538710-7904-40dc-afac-8d821d6331d5 on hv-cinder-85442 Aug 31 13:03:47.868273 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-d418ad6f-2e5d-4701-9738-e57d425852d5 req-75848257-2c52-4e07-99d1-503660b6b828 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031059 Aug 31 13:03:47.868868 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 248/478] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:03:47.941898 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-6bc6b4a1-0982-43be-8c8d-c641120378bd tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:03:47.942428 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-6bc6b4a1-0982-43be-8c8d-c641120378bd tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: a7538710-7904-40dc-afac-8d821d6331d5] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:03:47.949591 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6bc6b4a1-0982-43be-8c8d-c641120378bd tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:47.950078 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6bc6b4a1-0982-43be-8c8d-c641120378bd tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:47.950514 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6bc6b4a1-0982-43be-8c8d-c641120378bd tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:47.951210 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6bc6b4a1-0982-43be-8c8d-c641120378bd tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:47.951662 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6bc6b4a1-0982-43be-8c8d-c641120378bd tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:47.952117 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6bc6b4a1-0982-43be-8c8d-c641120378bd tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:48.022038 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-6bc6b4a1-0982-43be-8c8d-c641120378bd tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf155bc9925646f59e92f597782a8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c401f76027848f0980f470af73e4473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:03:48.030488 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-6bc6b4a1-0982-43be-8c8d-c641120378bd tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5" status: 200 len: 1304 microversion: 2.1 time: 0.092638 Aug 31 13:03:48.031093 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 231/479] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:03:47 2022] GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5 => generated 1304 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:03:49.055949 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-54032162-e79b-4073-9940-73d0bfa41266 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:03:49.056645 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-54032162-e79b-4073-9940-73d0bfa41266 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: a7538710-7904-40dc-afac-8d821d6331d5] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:03:49.063630 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-54032162-e79b-4073-9940-73d0bfa41266 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:49.064213 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-54032162-e79b-4073-9940-73d0bfa41266 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:49.064645 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-54032162-e79b-4073-9940-73d0bfa41266 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:49.065336 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-54032162-e79b-4073-9940-73d0bfa41266 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:03:49.065787 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-54032162-e79b-4073-9940-73d0bfa41266 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:03:49.066209 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-54032162-e79b-4073-9940-73d0bfa41266 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:03:49.080581 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.wsgi [None req-54032162-e79b-4073-9940-73d0bfa41266 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] HTTP exception thrown: Instance a7538710-7904-40dc-afac-8d821d6331d5 could not be found. Aug 31 13:03:49.082202 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-54032162-e79b-4073-9940-73d0bfa41266 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Request method failure captured: Aug 31 13:03:49.082202 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: request: GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5 HTTP/1.1 Aug 31 13:03:49.082202 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept: application/json Aug 31 13:03:49.082202 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept-Encoding: identity Aug 31 13:03:49.082202 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Connection: close Aug 31 13:03:49.082202 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Length: 0 Aug 31 13:03:49.082202 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Type: application/json Aug 31 13:03:49.082202 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Host: 10.222.0.58 Aug 31 13:03:49.082202 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Openstack-System-Scope: None Aug 31 13:03:49.082202 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: User-Agent: python-urllib3/1.26.12 Aug 31 13:03:49.082202 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Auth-Token: gAAAAABjD1vFxan8-kkdMPdlz4LEpJzwkXvPBfF8qzegPKP95q_RPeSv7PmzQx02DhHinKDqsr4mN-oF1XCCD2WkGLCl97pP8DCp1d5pPhuXs_4P_tAfVowDxauw_z-x7CUlh0VotGc7bGvCqwap2B4zmodJbBYIiLYgPWbH98qP9iFdS7M703I Aug 31 13:03:49.082202 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Id: None Aug 31 13:03:49.082202 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Name: None Aug 31 13:03:49.082202 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Identity-Status: Confirmed Aug 31 13:03:49.082202 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Is-Admin-Project: True Aug 31 13:03:49.082202 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Id: default Aug 31 13:03:49.082202 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Name: Default Aug 31 13:03:49.082202 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Id: 7c401f76027848f0980f470af73e4473 Aug 31 13:03:49.082202 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Name: tempest-VolumesSnapshotTestJSON-683666343 Aug 31 13:03:49.082202 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Role: member,reader Aug 31 13:03:49.082202 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Roles: member,reader Aug 31 13:03:49.083707 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7c401f76027848f0980f470af73e4473"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7c401f76027848f0980f470af73e4473"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7c401f76027848f0980f470af73e4473"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7c401f76027848f0980f470af73e4473"}]}] Aug 31 13:03:49.083707 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant: tempest-VolumesSnapshotTestJSON-683666343 Aug 31 13:03:49.083707 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Id: 7c401f76027848f0980f470af73e4473 Aug 31 13:03:49.083707 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-683666343 Aug 31 13:03:49.083707 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User: tempest-VolumesSnapshotTestJSON-683666343-project Aug 31 13:03:49.083707 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Id: default Aug 31 13:03:49.083707 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Name: Default Aug 31 13:03:49.083707 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Id: bf155bc9925646f59e92f597782a8881 Aug 31 13:03:49.083707 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Name: tempest-VolumesSnapshotTestJSON-683666343-project Aug 31 13:03:49.083707 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: method: > Aug 31 13:03:49.083707 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: exception: Instance a7538710-7904-40dc-afac-8d821d6331d5 could not be found. Aug 31 13:03:49.083707 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: action_args: {'id': 'a7538710-7904-40dc-afac-8d821d6331d5'} Aug 31 13:03:49.084580 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:03:49.084580 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:03:49.084580 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 13:03:49.084580 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 13:03:49.084580 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 13:03:49.084580 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 13:03:49.084580 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 13:03:49.084580 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 13:03:49.084580 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 13:03:49.084580 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 13:03:49.084580 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7538710-7904-40dc-afac-8d821d6331d5 could not be found. Aug 31 13:03:49.084580 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:03:49.084580 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:03:49.084580 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:03:49.084580 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:03:49.084580 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:03:49.084580 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:03:49.084580 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:03:49.084580 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:03:49.084580 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:03:49.085928 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:03:49.085928 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 13:03:49.085928 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 13:03:49.085928 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 13:03:49.085928 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 13:03:49.085928 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 13:03:49.085928 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 13:03:49.085928 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7538710-7904-40dc-afac-8d821d6331d5 could not be found. Aug 31 13:03:49.085928 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:03:49.085928 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:03:49.085928 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:03:49.085928 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:03:49.085928 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:03:49.085928 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:03:49.085928 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:03:49.085928 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:03:49.085928 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7538710-7904-40dc-afac-8d821d6331d5 could not be found. Aug 31 13:03:49.085928 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:03:49.086982 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-54032162-e79b-4073-9940-73d0bfa41266 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Returning 404 to user: Instance a7538710-7904-40dc-afac-8d821d6331d5 could not be found. {{(pid=120704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:03:49.086982 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-54032162-e79b-4073-9940-73d0bfa41266 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5" status: 404 len: 111 microversion: 2.1 time: 0.033878 Aug 31 13:03:49.086982 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 249/480] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:03:49 2022] GET /compute/v2.1/servers/a7538710-7904-40dc-afac-8d821d6331d5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:04:03.218629 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-69f0f252-9294-460d-bbcf-4d01d7b6a088 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-833374800", "imageRef": "2aa55919-0f25-4e84-a2e1-f60acbe208b2", "flavorRef": "452", "networks": [{"uuid": "54e74ead-7f1c-470c-84e5-efe0b2dc10c2"}]}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:04:03.229342 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=7 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:04:03.230022 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=26,nova_cell1:INSERT=1 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:04:03.454234 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.network.neutron [None req-69f0f252-9294-460d-bbcf-4d01d7b6a088 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] validate_networks() for [('54e74ead-7f1c-470c-84e5-efe0b2dc10c2', None, None, None, None, None)] {{(pid=120705) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 13:04:03.814266 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-69f0f252-9294-460d-bbcf-4d01d7b6a088 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Flavor limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 13:04:03.814684 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-69f0f252-9294-460d-bbcf-4d01d7b6a088 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Image limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 13:04:03.815148 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-69f0f252-9294-460d-bbcf-4d01d7b6a088 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Flavor pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 13:04:03.815545 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-69f0f252-9294-460d-bbcf-4d01d7b6a088 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Image pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 13:04:03.816059 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-69f0f252-9294-460d-bbcf-4d01d7b6a088 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 13:04:03.826022 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-69f0f252-9294-460d-bbcf-4d01d7b6a088 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:03.826406 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-69f0f252-9294-460d-bbcf-4d01d7b6a088 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:03.826801 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-69f0f252-9294-460d-bbcf-4d01d7b6a088 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:03.827513 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-69f0f252-9294-460d-bbcf-4d01d7b6a088 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:03.828022 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-69f0f252-9294-460d-bbcf-4d01d7b6a088 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:03.828436 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-69f0f252-9294-460d-bbcf-4d01d7b6a088 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:03.845428 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-69f0f252-9294-460d-bbcf-4d01d7b6a088 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Getting quotas for project 7c401f76027848f0980f470af73e4473. Resources: {'instances', 'ram', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 13:04:03.849602 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-69f0f252-9294-460d-bbcf-4d01d7b6a088 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Getting quotas for user bf155bc9925646f59e92f597782a8881 and project 7c401f76027848f0980f470af73e4473. Resources: {'instances', 'ram', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 13:04:03.863738 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-69f0f252-9294-460d-bbcf-4d01d7b6a088 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Going to run 1 instances... {{(pid=120705) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 13:04:03.866170 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-69f0f252-9294-460d-bbcf-4d01d7b6a088 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: 93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2aa55919-0f25-4e84-a2e1-f60acbe208b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120705) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 13:04:03.915648 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-69f0f252-9294-460d-bbcf-4d01d7b6a088 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.702747 Aug 31 13:04:03.916375 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 232/481] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 31 13:04:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 13:04:03.927406 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-72111425-68a8-45dc-92f6-74e733e36bfc tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:04:03.928030 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-72111425-68a8-45dc-92f6-74e733e36bfc tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: 93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:03.931662 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:04:03.932504 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:04:04.098620 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-72111425-68a8-45dc-92f6-74e733e36bfc tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf155bc9925646f59e92f597782a8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c401f76027848f0980f470af73e4473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:04:04.106278 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-72111425-68a8-45dc-92f6-74e733e36bfc tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "GET /compute/v2.1/servers/93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2" status: 200 len: 1218 microversion: 2.1 time: 0.182597 Aug 31 13:04:04.106935 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 250/482] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:04:03 2022] GET /compute/v2.1/servers/93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2 => generated 1218 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:04:04.863940 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-bf7e9fab-341e-4292-a6ad-0713379fbf5f tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:04:04.864522 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-bf7e9fab-341e-4292-a6ad-0713379fbf5f tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ba62b7ce-5880-4281-a5a4-020d70e5b16d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:04.871477 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bf7e9fab-341e-4292-a6ad-0713379fbf5f tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:04.871987 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bf7e9fab-341e-4292-a6ad-0713379fbf5f tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:04.872410 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bf7e9fab-341e-4292-a6ad-0713379fbf5f tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:04.873191 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bf7e9fab-341e-4292-a6ad-0713379fbf5f tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:04.873628 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bf7e9fab-341e-4292-a6ad-0713379fbf5f tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:04.874043 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bf7e9fab-341e-4292-a6ad-0713379fbf5f tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:04.896971 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-bf7e9fab-341e-4292-a6ad-0713379fbf5f tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d/ips" status: 200 len: 150 microversion: 2.1 time: 0.037488 Aug 31 13:04:04.897530 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 233/483] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 31 13:04:04 2022] GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:04:05.127693 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-36538c19-6d20-4187-b3dd-2666c1fafda6 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:04:05.128412 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-36538c19-6d20-4187-b3dd-2666c1fafda6 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: 93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:05.136072 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-36538c19-6d20-4187-b3dd-2666c1fafda6 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:05.136660 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-36538c19-6d20-4187-b3dd-2666c1fafda6 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:05.137111 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-36538c19-6d20-4187-b3dd-2666c1fafda6 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:05.138000 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-36538c19-6d20-4187-b3dd-2666c1fafda6 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:05.138495 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-36538c19-6d20-4187-b3dd-2666c1fafda6 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:05.138881 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-36538c19-6d20-4187-b3dd-2666c1fafda6 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:05.211989 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-36538c19-6d20-4187-b3dd-2666c1fafda6 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf155bc9925646f59e92f597782a8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c401f76027848f0980f470af73e4473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:04:05.220944 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-36538c19-6d20-4187-b3dd-2666c1fafda6 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "GET /compute/v2.1/servers/93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2" status: 200 len: 1270 microversion: 2.1 time: 0.097845 Aug 31 13:04:05.222002 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 251/484] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:04:05 2022] GET /compute/v2.1/servers/93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2 => generated 1270 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:04:06.242498 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-32428913-26fb-425c-9c42-bff826bbe3bf tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:04:06.243099 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-32428913-26fb-425c-9c42-bff826bbe3bf tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: 93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:06.250298 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-32428913-26fb-425c-9c42-bff826bbe3bf tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:06.250761 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-32428913-26fb-425c-9c42-bff826bbe3bf tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:06.251405 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-32428913-26fb-425c-9c42-bff826bbe3bf tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:06.252117 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-32428913-26fb-425c-9c42-bff826bbe3bf tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:06.252579 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-32428913-26fb-425c-9c42-bff826bbe3bf tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:06.252998 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-32428913-26fb-425c-9c42-bff826bbe3bf tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:06.390231 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-32428913-26fb-425c-9c42-bff826bbe3bf tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf155bc9925646f59e92f597782a8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c401f76027848f0980f470af73e4473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:04:06.397858 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-32428913-26fb-425c-9c42-bff826bbe3bf tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "GET /compute/v2.1/servers/93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2" status: 200 len: 1318 microversion: 2.1 time: 0.159315 Aug 31 13:04:06.398455 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 234/485] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:04:06 2022] GET /compute/v2.1/servers/93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:04:06.669336 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-7bca3c1a-bf79-46a6-8e38-4a23a5337be4 req-0bc3c128-541c-4850-95ae-522d46744a7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2", "tag": "59fdf56b-6c3e-46f9-aac8-f378b6df70d4"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:04:06.680917 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-7bca3c1a-bf79-46a6-8e38-4a23a5337be4 req-0bc3c128-541c-4850-95ae-522d46744a7a service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:06.680917 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-7bca3c1a-bf79-46a6-8e38-4a23a5337be4 req-0bc3c128-541c-4850-95ae-522d46744a7a service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:06.681483 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-7bca3c1a-bf79-46a6-8e38-4a23a5337be4 req-0bc3c128-541c-4850-95ae-522d46744a7a service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:06.706585 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-7bca3c1a-bf79-46a6-8e38-4a23a5337be4 req-0bc3c128-541c-4850-95ae-522d46744a7a service nova] Creating event network-changed:59fdf56b-6c3e-46f9-aac8-f378b6df70d4 for instance 93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2 on hv-cinder-85442 Aug 31 13:04:06.712563 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-7bca3c1a-bf79-46a6-8e38-4a23a5337be4 req-0bc3c128-541c-4850-95ae-522d46744a7a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047128 Aug 31 13:04:06.713184 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 252/486] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:04:07.342224 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-cfa1931b-bfef-4e6c-a3d0-2a8b5917d639 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8680ae01-8489-42f5-b63f-622cda4dcf14"}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:04:07.344762 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-cfa1931b-bfef-4e6c-a3d0-2a8b5917d639 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ba62b7ce-5880-4281-a5a4-020d70e5b16d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:07.351727 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cfa1931b-bfef-4e6c-a3d0-2a8b5917d639 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:07.352256 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cfa1931b-bfef-4e6c-a3d0-2a8b5917d639 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:07.352690 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cfa1931b-bfef-4e6c-a3d0-2a8b5917d639 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:07.353426 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cfa1931b-bfef-4e6c-a3d0-2a8b5917d639 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:07.353878 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cfa1931b-bfef-4e6c-a3d0-2a8b5917d639 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:07.354298 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cfa1931b-bfef-4e6c-a3d0-2a8b5917d639 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:07.419214 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-0c760d2c-97dd-4d09-a5a9-0bb629cf6d3a tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:04:07.420077 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-0c760d2c-97dd-4d09-a5a9-0bb629cf6d3a tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: 93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:07.426567 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0c760d2c-97dd-4d09-a5a9-0bb629cf6d3a tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:07.426911 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0c760d2c-97dd-4d09-a5a9-0bb629cf6d3a tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:07.427355 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0c760d2c-97dd-4d09-a5a9-0bb629cf6d3a tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:07.428071 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0c760d2c-97dd-4d09-a5a9-0bb629cf6d3a tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:07.428510 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0c760d2c-97dd-4d09-a5a9-0bb629cf6d3a tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:07.428914 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0c760d2c-97dd-4d09-a5a9-0bb629cf6d3a tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:07.564013 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-0c760d2c-97dd-4d09-a5a9-0bb629cf6d3a tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf155bc9925646f59e92f597782a8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c401f76027848f0980f470af73e4473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:04:07.572278 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-0c760d2c-97dd-4d09-a5a9-0bb629cf6d3a tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "GET /compute/v2.1/servers/93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2" status: 200 len: 1318 microversion: 2.1 time: 0.157291 Aug 31 13:04:07.573519 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 253/487] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:04:07 2022] GET /compute/v2.1/servers/93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:04:07.728486 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-cfa1931b-bfef-4e6c-a3d0-2a8b5917d639 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "POST /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.390107 Aug 31 13:04:07.729088 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 235/488] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 31 13:04:07 2022] POST /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d/os-volume_attachments => generated 194 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:04:08.595702 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-cb4f79c4-d297-42ae-943f-cb16958b62ee tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:04:08.596614 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-cb4f79c4-d297-42ae-943f-cb16958b62ee tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: 93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:08.603880 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cb4f79c4-d297-42ae-943f-cb16958b62ee tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:08.604608 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cb4f79c4-d297-42ae-943f-cb16958b62ee tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:08.605216 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cb4f79c4-d297-42ae-943f-cb16958b62ee tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:08.606068 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cb4f79c4-d297-42ae-943f-cb16958b62ee tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:08.606659 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cb4f79c4-d297-42ae-943f-cb16958b62ee tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:08.607225 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cb4f79c4-d297-42ae-943f-cb16958b62ee tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:08.736480 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-cb4f79c4-d297-42ae-943f-cb16958b62ee tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf155bc9925646f59e92f597782a8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c401f76027848f0980f470af73e4473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:04:08.744338 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-cb4f79c4-d297-42ae-943f-cb16958b62ee tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "GET /compute/v2.1/servers/93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2" status: 200 len: 1318 microversion: 2.1 time: 0.154003 Aug 31 13:04:08.744878 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 254/489] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:04:08 2022] GET /compute/v2.1/servers/93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:04:09.769778 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-d838589a-ed0f-40c2-a237-1db9dc099cd0 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:04:09.770914 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-d838589a-ed0f-40c2-a237-1db9dc099cd0 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: 93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:09.782059 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d838589a-ed0f-40c2-a237-1db9dc099cd0 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:09.782818 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d838589a-ed0f-40c2-a237-1db9dc099cd0 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:09.783553 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d838589a-ed0f-40c2-a237-1db9dc099cd0 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:09.784729 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d838589a-ed0f-40c2-a237-1db9dc099cd0 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:09.785861 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d838589a-ed0f-40c2-a237-1db9dc099cd0 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:09.786559 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d838589a-ed0f-40c2-a237-1db9dc099cd0 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:09.931143 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-d838589a-ed0f-40c2-a237-1db9dc099cd0 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf155bc9925646f59e92f597782a8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c401f76027848f0980f470af73e4473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:04:09.939253 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-d838589a-ed0f-40c2-a237-1db9dc099cd0 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "GET /compute/v2.1/servers/93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2" status: 200 len: 1318 microversion: 2.1 time: 0.176600 Aug 31 13:04:09.939850 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 236/490] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:04:09 2022] GET /compute/v2.1/servers/93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:04:10.959858 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-e3e21082-5bfa-43b9-be36-f80b73170b70 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:04:10.960459 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-e3e21082-5bfa-43b9-be36-f80b73170b70 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: 93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:10.968479 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e3e21082-5bfa-43b9-be36-f80b73170b70 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:10.968761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e3e21082-5bfa-43b9-be36-f80b73170b70 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:10.972004 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e3e21082-5bfa-43b9-be36-f80b73170b70 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:10.972004 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e3e21082-5bfa-43b9-be36-f80b73170b70 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:10.972004 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e3e21082-5bfa-43b9-be36-f80b73170b70 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:10.972004 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e3e21082-5bfa-43b9-be36-f80b73170b70 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:11.099436 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-e3e21082-5bfa-43b9-be36-f80b73170b70 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf155bc9925646f59e92f597782a8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c401f76027848f0980f470af73e4473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:04:11.107462 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-e3e21082-5bfa-43b9-be36-f80b73170b70 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "GET /compute/v2.1/servers/93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2" status: 200 len: 1318 microversion: 2.1 time: 0.151544 Aug 31 13:04:11.108044 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 255/491] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:04:10 2022] GET /compute/v2.1/servers/93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:04:12.128488 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-4e876422-6891-4ac3-9315-7087867d3325 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:04:12.129118 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-4e876422-6891-4ac3-9315-7087867d3325 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: 93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:12.145273 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4e876422-6891-4ac3-9315-7087867d3325 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:12.145754 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4e876422-6891-4ac3-9315-7087867d3325 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:12.146179 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4e876422-6891-4ac3-9315-7087867d3325 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:12.146861 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4e876422-6891-4ac3-9315-7087867d3325 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:12.147305 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4e876422-6891-4ac3-9315-7087867d3325 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:12.147742 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4e876422-6891-4ac3-9315-7087867d3325 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:12.287766 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-4e876422-6891-4ac3-9315-7087867d3325 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf155bc9925646f59e92f597782a8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c401f76027848f0980f470af73e4473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:04:12.296410 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-4e876422-6891-4ac3-9315-7087867d3325 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "GET /compute/v2.1/servers/93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2" status: 200 len: 1318 microversion: 2.1 time: 0.171995 Aug 31 13:04:12.296967 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 237/492] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:04:12 2022] GET /compute/v2.1/servers/93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:04:13.317528 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-cb61dd32-380b-4112-8b7b-ac6cdc7cea41 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:04:13.318111 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-cb61dd32-380b-4112-8b7b-ac6cdc7cea41 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: 93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:13.324373 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cb61dd32-380b-4112-8b7b-ac6cdc7cea41 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:13.324854 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cb61dd32-380b-4112-8b7b-ac6cdc7cea41 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:13.325287 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cb61dd32-380b-4112-8b7b-ac6cdc7cea41 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:13.326017 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cb61dd32-380b-4112-8b7b-ac6cdc7cea41 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:13.326458 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cb61dd32-380b-4112-8b7b-ac6cdc7cea41 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:13.326875 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cb61dd32-380b-4112-8b7b-ac6cdc7cea41 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:13.459329 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-cb61dd32-380b-4112-8b7b-ac6cdc7cea41 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf155bc9925646f59e92f597782a8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c401f76027848f0980f470af73e4473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:04:13.467168 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-cb61dd32-380b-4112-8b7b-ac6cdc7cea41 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "GET /compute/v2.1/servers/93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2" status: 200 len: 1318 microversion: 2.1 time: 0.153862 Aug 31 13:04:13.467764 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 256/493] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:04:13 2022] GET /compute/v2.1/servers/93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:04:14.492163 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-8452c636-7ca6-4175-80b7-92cb13e572b0 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:04:14.493039 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-8452c636-7ca6-4175-80b7-92cb13e572b0 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: 93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:14.496809 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=2 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:04:14.497895 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=6 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:04:14.506768 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8452c636-7ca6-4175-80b7-92cb13e572b0 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:14.507245 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8452c636-7ca6-4175-80b7-92cb13e572b0 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:14.507674 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8452c636-7ca6-4175-80b7-92cb13e572b0 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:14.508433 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8452c636-7ca6-4175-80b7-92cb13e572b0 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:14.508873 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8452c636-7ca6-4175-80b7-92cb13e572b0 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:14.509283 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8452c636-7ca6-4175-80b7-92cb13e572b0 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:14.647037 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-8452c636-7ca6-4175-80b7-92cb13e572b0 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf155bc9925646f59e92f597782a8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c401f76027848f0980f470af73e4473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:04:14.655038 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-8452c636-7ca6-4175-80b7-92cb13e572b0 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "GET /compute/v2.1/servers/93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2" status: 200 len: 1318 microversion: 2.1 time: 0.169656 Aug 31 13:04:14.655620 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 238/494] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:04:14 2022] GET /compute/v2.1/servers/93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:04:14.959689 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-4447b1f5-3301-4472-b1c2-9840d9e0df03 req-90b1d2d5-95e1-4416-b82e-22b84aea785c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2", "name": "network-vif-plugged", "status": "completed", "tag": "59fdf56b-6c3e-46f9-aac8-f378b6df70d4"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:04:14.964652 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell0:SELECT=2 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:04:14.971486 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-4447b1f5-3301-4472-b1c2-9840d9e0df03 req-90b1d2d5-95e1-4416-b82e-22b84aea785c service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:14.972058 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-4447b1f5-3301-4472-b1c2-9840d9e0df03 req-90b1d2d5-95e1-4416-b82e-22b84aea785c service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:14.972480 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-4447b1f5-3301-4472-b1c2-9840d9e0df03 req-90b1d2d5-95e1-4416-b82e-22b84aea785c service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:14.984617 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-4447b1f5-3301-4472-b1c2-9840d9e0df03 req-90b1d2d5-95e1-4416-b82e-22b84aea785c service nova] Creating event network-vif-plugged:59fdf56b-6c3e-46f9-aac8-f378b6df70d4 for instance 93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2 on hv-cinder-85442 Aug 31 13:04:14.989640 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-4447b1f5-3301-4472-b1c2-9840d9e0df03 req-90b1d2d5-95e1-4416-b82e-22b84aea785c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033698 Aug 31 13:04:14.990260 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 257/495] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:04:15.680584 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-0ef11198-09aa-495d-a2c9-645d222bccb5 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:04:15.681417 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-0ef11198-09aa-495d-a2c9-645d222bccb5 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: 93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:15.692500 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0ef11198-09aa-495d-a2c9-645d222bccb5 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:15.692976 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0ef11198-09aa-495d-a2c9-645d222bccb5 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:15.693398 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0ef11198-09aa-495d-a2c9-645d222bccb5 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:15.694074 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0ef11198-09aa-495d-a2c9-645d222bccb5 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:15.694521 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0ef11198-09aa-495d-a2c9-645d222bccb5 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:15.694929 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0ef11198-09aa-495d-a2c9-645d222bccb5 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:15.828287 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-0ef11198-09aa-495d-a2c9-645d222bccb5 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf155bc9925646f59e92f597782a8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c401f76027848f0980f470af73e4473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:04:15.836703 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-0ef11198-09aa-495d-a2c9-645d222bccb5 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "GET /compute/v2.1/servers/93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2" status: 200 len: 1318 microversion: 2.1 time: 0.162777 Aug 31 13:04:15.837273 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 239/496] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:04:15 2022] GET /compute/v2.1/servers/93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:04:16.864579 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-a58656c0-3b55-4d1b-b848-72530cd3d870 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:04:16.865261 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-a58656c0-3b55-4d1b-b848-72530cd3d870 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: 93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:16.872219 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a58656c0-3b55-4d1b-b848-72530cd3d870 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:16.872692 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a58656c0-3b55-4d1b-b848-72530cd3d870 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:16.873118 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a58656c0-3b55-4d1b-b848-72530cd3d870 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:16.873803 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a58656c0-3b55-4d1b-b848-72530cd3d870 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:16.874247 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a58656c0-3b55-4d1b-b848-72530cd3d870 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:16.874665 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a58656c0-3b55-4d1b-b848-72530cd3d870 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:17.006007 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-a58656c0-3b55-4d1b-b848-72530cd3d870 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf155bc9925646f59e92f597782a8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c401f76027848f0980f470af73e4473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:04:17.013841 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-a58656c0-3b55-4d1b-b848-72530cd3d870 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "GET /compute/v2.1/servers/93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2" status: 200 len: 1318 microversion: 2.1 time: 0.156893 Aug 31 13:04:17.014388 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 258/497] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:04:16 2022] GET /compute/v2.1/servers/93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:04:18.037414 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-11bab19d-f578-4011-9e78-d916e57d20e2 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:04:18.038080 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-11bab19d-f578-4011-9e78-d916e57d20e2 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: 93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:18.045120 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-11bab19d-f578-4011-9e78-d916e57d20e2 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:18.045600 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-11bab19d-f578-4011-9e78-d916e57d20e2 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:18.046029 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-11bab19d-f578-4011-9e78-d916e57d20e2 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:18.046713 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-11bab19d-f578-4011-9e78-d916e57d20e2 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:18.047145 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-11bab19d-f578-4011-9e78-d916e57d20e2 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:18.047581 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-11bab19d-f578-4011-9e78-d916e57d20e2 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:18.190682 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-11bab19d-f578-4011-9e78-d916e57d20e2 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf155bc9925646f59e92f597782a8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c401f76027848f0980f470af73e4473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:04:18.198852 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-11bab19d-f578-4011-9e78-d916e57d20e2 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "GET /compute/v2.1/servers/93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2" status: 200 len: 1507 microversion: 2.1 time: 0.167668 Aug 31 13:04:18.199426 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 240/498] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:04:18 2022] GET /compute/v2.1/servers/93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2 => generated 1507 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:04:18.219257 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-2e32ef8e-5359-4ba4-9708-772a54b9bc4f tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93f029fb-b70c-4c19-8f56-7c5688cd7816", "device": "/dev/sdb"}} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:04:18.222120 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-2e32ef8e-5359-4ba4-9708-772a54b9bc4f tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: 93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:18.228974 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2e32ef8e-5359-4ba4-9708-772a54b9bc4f tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:18.229504 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2e32ef8e-5359-4ba4-9708-772a54b9bc4f tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:18.229892 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2e32ef8e-5359-4ba4-9708-772a54b9bc4f tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:18.230691 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2e32ef8e-5359-4ba4-9708-772a54b9bc4f tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:18.231130 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2e32ef8e-5359-4ba4-9708-772a54b9bc4f tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:18.231574 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2e32ef8e-5359-4ba4-9708-772a54b9bc4f tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:19.066632 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-2e32ef8e-5359-4ba4-9708-772a54b9bc4f tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "POST /compute/v2.1/servers/93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.851228 Aug 31 13:04:19.067301 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 259/499] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 31 13:04:18 2022] POST /compute/v2.1/servers/93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2/os-volume_attachments => generated 194 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:04:20.665103 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-0ad6b10a-5eac-46e6-91ea-2fe48c0daae7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Action: 'create', calling method: .version_select at 0x7f19515c01f0>, body: {"keypair": {"name": "tempest-keypair-798286424", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOrCDTTn7WDN48hL63o8BODBRTd1cvUEyAskvKCLEJRxolozINAQFokR2KkSEjIMlXqB6QzFJ88NL0QmgE5CpXQU9gcQ2UeyAb+xPhCHknfOvqyOCTXqWTmhGKoi1IQOOg=="}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:04:20.681272 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-0ad6b10a-5eac-46e6-91ea-2fe48c0daae7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Getting quotas for project fdf85a7b31004baf848842ad2f74cbf0. Resources: {'key_pairs'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 13:04:20.685154 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-0ad6b10a-5eac-46e6-91ea-2fe48c0daae7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Getting quotas for user ac2a50988be24e20be034777225d8106 and project fdf85a7b31004baf848842ad2f74cbf0. Resources: {'key_pairs'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 13:04:20.709034 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-0ad6b10a-5eac-46e6-91ea-2fe48c0daae7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047949 Aug 31 13:04:20.709687 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 241/500] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 31 13:04:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:04:22.036827 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-35f47e75-e3ca-488b-9965-69e6bbc83fd6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1250589589", "imageRef": "2aa55919-0f25-4e84-a2e1-f60acbe208b2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fb3a8ad8-8a96-4988-83d8-367334d3fb95"}], "security_groups": [{"name": "tempest-securitygroup--381115082"}], "key_name": "tempest-keypair-798286424", "user_data": "}} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:04:22.142210 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.network.neutron [None req-35f47e75-e3ca-488b-9965-69e6bbc83fd6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] validate_networks() for [('fb3a8ad8-8a96-4988-83d8-367334d3fb95', None, None, None, None, None)] {{(pid=120704) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 13:04:22.567021 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.virt.hardware [None req-35f47e75-e3ca-488b-9965-69e6bbc83fd6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Flavor limits 0:0:0 {{(pid=120704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 13:04:22.567445 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.virt.hardware [None req-35f47e75-e3ca-488b-9965-69e6bbc83fd6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Image limits 0:0:0 {{(pid=120704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 13:04:22.568020 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.virt.hardware [None req-35f47e75-e3ca-488b-9965-69e6bbc83fd6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Flavor pref 0:0:0 {{(pid=120704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 13:04:22.568427 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.virt.hardware [None req-35f47e75-e3ca-488b-9965-69e6bbc83fd6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Image pref 0:0:0 {{(pid=120704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 13:04:22.568840 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.virt.hardware [None req-35f47e75-e3ca-488b-9965-69e6bbc83fd6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 13:04:22.578699 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-35f47e75-e3ca-488b-9965-69e6bbc83fd6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:22.579181 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-35f47e75-e3ca-488b-9965-69e6bbc83fd6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:22.579608 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-35f47e75-e3ca-488b-9965-69e6bbc83fd6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:22.580359 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-35f47e75-e3ca-488b-9965-69e6bbc83fd6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:22.580806 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-35f47e75-e3ca-488b-9965-69e6bbc83fd6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:22.581230 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-35f47e75-e3ca-488b-9965-69e6bbc83fd6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:22.598500 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.quota [None req-35f47e75-e3ca-488b-9965-69e6bbc83fd6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Getting quotas for project fdf85a7b31004baf848842ad2f74cbf0. Resources: {'instances', 'ram', 'cores'} {{(pid=120704) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 13:04:22.602612 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.quota [None req-35f47e75-e3ca-488b-9965-69e6bbc83fd6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Getting quotas for user ac2a50988be24e20be034777225d8106 and project fdf85a7b31004baf848842ad2f74cbf0. Resources: {'instances', 'ram', 'cores'} {{(pid=120704) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 13:04:22.614681 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-35f47e75-e3ca-488b-9965-69e6bbc83fd6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Going to run 1 instances... {{(pid=120704) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 13:04:22.617202 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-35f47e75-e3ca-488b-9965-69e6bbc83fd6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2aa55919-0f25-4e84-a2e1-f60acbe208b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120704) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 13:04:22.666551 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR oslo.messaging._drivers.impl_rabbit [None req-35f47e75-e3ca-488b-9965-69e6bbc83fd6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [415c0c6c-b74e-430a-a640-87f610d5125b] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 13:04:23.679721 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO oslo.messaging._drivers.impl_rabbit [None req-35f47e75-e3ca-488b-9965-69e6bbc83fd6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [415c0c6c-b74e-430a-a640-87f610d5125b] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 41178. Aug 31 13:04:23.684468 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-35f47e75-e3ca-488b-9965-69e6bbc83fd6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.652797 Aug 31 13:04:23.685284 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 260/501] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 31 13:04:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 1654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 13:04:23.697146 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-21385abb-a06a-4dad-ba99-d55b9030b7b3 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:04:23.697750 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-21385abb-a06a-4dad-ba99-d55b9030b7b3 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:23.757863 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-21385abb-a06a-4dad-ba99-d55b9030b7b3 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:04:23.765315 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-21385abb-a06a-4dad-ba99-d55b9030b7b3 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e" status: 200 len: 1241 microversion: 2.1 time: 0.072556 Aug 31 13:04:23.765919 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 242/502] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:04:23 2022] GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:04:24.787211 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-aab3be16-180e-4efa-85cc-6c9d70ca15e5 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:04:24.787838 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-aab3be16-180e-4efa-85cc-6c9d70ca15e5 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:24.795093 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-aab3be16-180e-4efa-85cc-6c9d70ca15e5 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:24.795562 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-aab3be16-180e-4efa-85cc-6c9d70ca15e5 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:24.796025 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-aab3be16-180e-4efa-85cc-6c9d70ca15e5 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:24.796710 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-aab3be16-180e-4efa-85cc-6c9d70ca15e5 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:24.797146 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-aab3be16-180e-4efa-85cc-6c9d70ca15e5 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:24.797557 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-aab3be16-180e-4efa-85cc-6c9d70ca15e5 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:24.860454 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-aab3be16-180e-4efa-85cc-6c9d70ca15e5 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:04:24.871040 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-aab3be16-180e-4efa-85cc-6c9d70ca15e5 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e" status: 200 len: 1293 microversion: 2.1 time: 0.088780 Aug 31 13:04:24.871649 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 261/503] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:04:24 2022] GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e => generated 1293 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:04:25.896371 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-dd44c0e2-ecf2-4450-b382-3d72c08768ad tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:04:25.896971 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-dd44c0e2-ecf2-4450-b382-3d72c08768ad tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:25.904108 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dd44c0e2-ecf2-4450-b382-3d72c08768ad tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:25.904617 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dd44c0e2-ecf2-4450-b382-3d72c08768ad tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:25.905022 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dd44c0e2-ecf2-4450-b382-3d72c08768ad tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:25.905687 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dd44c0e2-ecf2-4450-b382-3d72c08768ad tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:25.906130 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dd44c0e2-ecf2-4450-b382-3d72c08768ad tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:25.906545 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dd44c0e2-ecf2-4450-b382-3d72c08768ad tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:25.971800 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-dd44c0e2-ecf2-4450-b382-3d72c08768ad tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:04:25.979669 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-dd44c0e2-ecf2-4450-b382-3d72c08768ad tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e" status: 200 len: 1299 microversion: 2.1 time: 0.089280 Aug 31 13:04:25.980304 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 243/504] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:04:25 2022] GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e => generated 1299 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:04:27.003691 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-aca79af1-fcfc-46c7-856a-308eec2cb698 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:04:27.004948 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-aca79af1-fcfc-46c7-856a-308eec2cb698 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:27.018120 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-aca79af1-fcfc-46c7-856a-308eec2cb698 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:27.018703 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-aca79af1-fcfc-46c7-856a-308eec2cb698 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:27.019205 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-aca79af1-fcfc-46c7-856a-308eec2cb698 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:27.020023 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-aca79af1-fcfc-46c7-856a-308eec2cb698 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:27.020538 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-aca79af1-fcfc-46c7-856a-308eec2cb698 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:27.021029 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-aca79af1-fcfc-46c7-856a-308eec2cb698 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:27.166060 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-aca79af1-fcfc-46c7-856a-308eec2cb698 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:04:27.176763 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-aca79af1-fcfc-46c7-856a-308eec2cb698 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e" status: 200 len: 1366 microversion: 2.1 time: 0.180016 Aug 31 13:04:27.177408 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 262/505] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:04:26 2022] GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:04:27.878636 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-40ca5d2c-bdfd-4931-a164-37d5cff2aba2 req-886d670e-44e0-4b0c-b1eb-a56c237d4927 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e", "tag": "0223c49a-2ae0-45b1-8627-a290b23cfabb"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:04:27.888840 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-40ca5d2c-bdfd-4931-a164-37d5cff2aba2 req-886d670e-44e0-4b0c-b1eb-a56c237d4927 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:27.889632 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-40ca5d2c-bdfd-4931-a164-37d5cff2aba2 req-886d670e-44e0-4b0c-b1eb-a56c237d4927 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:27.890038 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-40ca5d2c-bdfd-4931-a164-37d5cff2aba2 req-886d670e-44e0-4b0c-b1eb-a56c237d4927 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:27.901732 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-40ca5d2c-bdfd-4931-a164-37d5cff2aba2 req-886d670e-44e0-4b0c-b1eb-a56c237d4927 service nova] Creating event network-changed:0223c49a-2ae0-45b1-8627-a290b23cfabb for instance ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e on hv-cinder-85442 Aug 31 13:04:27.906771 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-40ca5d2c-bdfd-4931-a164-37d5cff2aba2 req-886d670e-44e0-4b0c-b1eb-a56c237d4927 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032990 Aug 31 13:04:27.907392 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 244/506] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:04:28.198879 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-251c5cc2-cdf6-414b-97c5-df9236acb2ed tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:04:28.199595 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-251c5cc2-cdf6-414b-97c5-df9236acb2ed tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:28.206494 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-251c5cc2-cdf6-414b-97c5-df9236acb2ed tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:28.206977 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-251c5cc2-cdf6-414b-97c5-df9236acb2ed tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:28.207476 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-251c5cc2-cdf6-414b-97c5-df9236acb2ed tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:28.208238 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-251c5cc2-cdf6-414b-97c5-df9236acb2ed tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:28.208691 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-251c5cc2-cdf6-414b-97c5-df9236acb2ed tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:28.209109 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-251c5cc2-cdf6-414b-97c5-df9236acb2ed tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:28.343852 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-251c5cc2-cdf6-414b-97c5-df9236acb2ed tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:04:28.352019 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-251c5cc2-cdf6-414b-97c5-df9236acb2ed tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e" status: 200 len: 1366 microversion: 2.1 time: 0.157938 Aug 31 13:04:28.352606 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 263/507] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:04:28 2022] GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:04:29.377934 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-8d827e6c-c4e4-41ca-9d79-9b49e8c3cd3e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:04:29.378917 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-8d827e6c-c4e4-41ca-9d79-9b49e8c3cd3e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:29.386100 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8d827e6c-c4e4-41ca-9d79-9b49e8c3cd3e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:29.386618 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8d827e6c-c4e4-41ca-9d79-9b49e8c3cd3e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:29.387703 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8d827e6c-c4e4-41ca-9d79-9b49e8c3cd3e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:29.387703 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8d827e6c-c4e4-41ca-9d79-9b49e8c3cd3e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:29.388270 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8d827e6c-c4e4-41ca-9d79-9b49e8c3cd3e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:29.388591 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8d827e6c-c4e4-41ca-9d79-9b49e8c3cd3e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:29.527781 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-8d827e6c-c4e4-41ca-9d79-9b49e8c3cd3e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:04:29.536235 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-8d827e6c-c4e4-41ca-9d79-9b49e8c3cd3e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e" status: 200 len: 1366 microversion: 2.1 time: 0.166116 Aug 31 13:04:29.536850 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 245/508] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:04:29 2022] GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:04:30.560478 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-b59ff779-cbc4-481b-9d89-dc5fb4cd4f82 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:04:30.561778 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-b59ff779-cbc4-481b-9d89-dc5fb4cd4f82 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:30.572817 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b59ff779-cbc4-481b-9d89-dc5fb4cd4f82 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:30.573616 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b59ff779-cbc4-481b-9d89-dc5fb4cd4f82 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:30.574573 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b59ff779-cbc4-481b-9d89-dc5fb4cd4f82 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:30.575731 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b59ff779-cbc4-481b-9d89-dc5fb4cd4f82 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:30.576589 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b59ff779-cbc4-481b-9d89-dc5fb4cd4f82 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:30.577481 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b59ff779-cbc4-481b-9d89-dc5fb4cd4f82 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:30.722333 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-b59ff779-cbc4-481b-9d89-dc5fb4cd4f82 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:04:30.730569 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-b59ff779-cbc4-481b-9d89-dc5fb4cd4f82 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e" status: 200 len: 1366 microversion: 2.1 time: 0.176601 Aug 31 13:04:30.731150 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 264/509] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:04:30 2022] GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:04:31.754783 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-74387f49-ce4e-48a1-a858-ca959b131590 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:04:31.755474 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-74387f49-ce4e-48a1-a858-ca959b131590 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:31.762815 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-74387f49-ce4e-48a1-a858-ca959b131590 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:31.763357 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-74387f49-ce4e-48a1-a858-ca959b131590 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:31.763798 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-74387f49-ce4e-48a1-a858-ca959b131590 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:31.764577 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-74387f49-ce4e-48a1-a858-ca959b131590 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:31.765049 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-74387f49-ce4e-48a1-a858-ca959b131590 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:31.765490 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-74387f49-ce4e-48a1-a858-ca959b131590 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:31.903654 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-74387f49-ce4e-48a1-a858-ca959b131590 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:04:31.911800 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-74387f49-ce4e-48a1-a858-ca959b131590 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e" status: 200 len: 1366 microversion: 2.1 time: 0.163572 Aug 31 13:04:31.912407 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 246/510] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:04:31 2022] GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:04:32.935302 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-d5a424f2-ee30-4283-ab6a-641ed5bb6080 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:04:32.936149 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-d5a424f2-ee30-4283-ab6a-641ed5bb6080 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:32.939364 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell0:SELECT=2 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:04:32.940338 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell0:SELECT=6 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:04:32.946941 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d5a424f2-ee30-4283-ab6a-641ed5bb6080 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:32.947431 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d5a424f2-ee30-4283-ab6a-641ed5bb6080 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:32.947844 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d5a424f2-ee30-4283-ab6a-641ed5bb6080 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:32.948558 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d5a424f2-ee30-4283-ab6a-641ed5bb6080 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:32.948992 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d5a424f2-ee30-4283-ab6a-641ed5bb6080 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:32.949389 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d5a424f2-ee30-4283-ab6a-641ed5bb6080 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:33.092865 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-d5a424f2-ee30-4283-ab6a-641ed5bb6080 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:04:33.102820 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-d5a424f2-ee30-4283-ab6a-641ed5bb6080 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e" status: 200 len: 1366 microversion: 2.1 time: 0.173299 Aug 31 13:04:33.103416 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 265/511] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:04:32 2022] GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:04:34.124565 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-f0495b27-0196-4cb3-b81e-b7d097f3bcdd tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:04:34.125294 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-f0495b27-0196-4cb3-b81e-b7d097f3bcdd tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:34.128856 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=6 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:04:34.129662 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=4 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:04:34.133859 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f0495b27-0196-4cb3-b81e-b7d097f3bcdd tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:34.134387 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f0495b27-0196-4cb3-b81e-b7d097f3bcdd tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:34.134821 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f0495b27-0196-4cb3-b81e-b7d097f3bcdd tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:34.135515 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f0495b27-0196-4cb3-b81e-b7d097f3bcdd tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:34.135987 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f0495b27-0196-4cb3-b81e-b7d097f3bcdd tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:34.136408 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f0495b27-0196-4cb3-b81e-b7d097f3bcdd tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:34.141480 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:04:34.276281 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-f0495b27-0196-4cb3-b81e-b7d097f3bcdd tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:04:34.284376 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-f0495b27-0196-4cb3-b81e-b7d097f3bcdd tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e" status: 200 len: 1366 microversion: 2.1 time: 0.163783 Aug 31 13:04:34.285309 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 247/512] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:04:34 2022] GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:04:35.308588 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-6464add7-2db9-4fb1-8247-d5f18748f51b tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:04:35.309638 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-6464add7-2db9-4fb1-8247-d5f18748f51b tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:35.313414 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:04:35.320500 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6464add7-2db9-4fb1-8247-d5f18748f51b tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:35.320961 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6464add7-2db9-4fb1-8247-d5f18748f51b tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:35.321394 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6464add7-2db9-4fb1-8247-d5f18748f51b tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:35.322084 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6464add7-2db9-4fb1-8247-d5f18748f51b tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:35.322530 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6464add7-2db9-4fb1-8247-d5f18748f51b tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:35.322948 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6464add7-2db9-4fb1-8247-d5f18748f51b tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:35.326410 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:04:35.466057 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-6464add7-2db9-4fb1-8247-d5f18748f51b tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:04:35.475649 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-6464add7-2db9-4fb1-8247-d5f18748f51b tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e" status: 200 len: 1366 microversion: 2.1 time: 0.173454 Aug 31 13:04:35.476340 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 266/513] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:04:35 2022] GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:04:36.498974 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-17259800-1abc-48b3-81ce-5469908c9999 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:04:36.499641 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-17259800-1abc-48b3-81ce-5469908c9999 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:36.509286 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-17259800-1abc-48b3-81ce-5469908c9999 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:36.509920 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-17259800-1abc-48b3-81ce-5469908c9999 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:36.510541 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-17259800-1abc-48b3-81ce-5469908c9999 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:36.511455 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-17259800-1abc-48b3-81ce-5469908c9999 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:36.512100 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-17259800-1abc-48b3-81ce-5469908c9999 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:36.512640 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-17259800-1abc-48b3-81ce-5469908c9999 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:36.648449 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-17259800-1abc-48b3-81ce-5469908c9999 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:04:36.656269 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-17259800-1abc-48b3-81ce-5469908c9999 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e" status: 200 len: 1366 microversion: 2.1 time: 0.162633 Aug 31 13:04:36.656850 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 248/514] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:04:36 2022] GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:04:37.682151 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-d2821232-e4b7-47e6-87b9-233ca6f8df17 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:04:37.682996 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-d2821232-e4b7-47e6-87b9-233ca6f8df17 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:37.693170 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d2821232-e4b7-47e6-87b9-233ca6f8df17 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:37.693642 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d2821232-e4b7-47e6-87b9-233ca6f8df17 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:37.694029 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d2821232-e4b7-47e6-87b9-233ca6f8df17 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:37.694735 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d2821232-e4b7-47e6-87b9-233ca6f8df17 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:37.695172 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d2821232-e4b7-47e6-87b9-233ca6f8df17 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:37.695581 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d2821232-e4b7-47e6-87b9-233ca6f8df17 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:37.840034 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-d2821232-e4b7-47e6-87b9-233ca6f8df17 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:04:37.848260 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-d2821232-e4b7-47e6-87b9-233ca6f8df17 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e" status: 200 len: 1366 microversion: 2.1 time: 0.173051 Aug 31 13:04:37.848868 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 267/515] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:04:37 2022] GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:04:38.872588 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-9ddc6032-5d59-4196-aaab-1c002c843392 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:04:38.873547 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-9ddc6032-5d59-4196-aaab-1c002c843392 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:38.884434 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9ddc6032-5d59-4196-aaab-1c002c843392 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:38.885218 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9ddc6032-5d59-4196-aaab-1c002c843392 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:38.885944 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9ddc6032-5d59-4196-aaab-1c002c843392 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:38.887062 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9ddc6032-5d59-4196-aaab-1c002c843392 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:38.887800 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9ddc6032-5d59-4196-aaab-1c002c843392 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:38.888539 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9ddc6032-5d59-4196-aaab-1c002c843392 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:39.034007 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-9ddc6032-5d59-4196-aaab-1c002c843392 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:04:39.042647 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-9ddc6032-5d59-4196-aaab-1c002c843392 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e" status: 200 len: 1366 microversion: 2.1 time: 0.176474 Aug 31 13:04:39.043233 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 249/516] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:04:38 2022] GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:04:40.065259 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-b4b6670b-3324-49d6-9527-b1778cf6c20b tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:04:40.065827 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-b4b6670b-3324-49d6-9527-b1778cf6c20b tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:40.073215 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b4b6670b-3324-49d6-9527-b1778cf6c20b tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:40.073675 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b4b6670b-3324-49d6-9527-b1778cf6c20b tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:40.074094 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b4b6670b-3324-49d6-9527-b1778cf6c20b tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:40.074763 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b4b6670b-3324-49d6-9527-b1778cf6c20b tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:40.075199 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b4b6670b-3324-49d6-9527-b1778cf6c20b tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:40.075604 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b4b6670b-3324-49d6-9527-b1778cf6c20b tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:40.215136 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-b4b6670b-3324-49d6-9527-b1778cf6c20b tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:04:40.223669 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-b4b6670b-3324-49d6-9527-b1778cf6c20b tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e" status: 200 len: 1366 microversion: 2.1 time: 0.162523 Aug 31 13:04:40.224291 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 268/517] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:04:40 2022] GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:04:41.248631 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-dd4cfcf6-a593-42ea-9a3e-eb842f6d1a95 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:04:41.249468 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-dd4cfcf6-a593-42ea-9a3e-eb842f6d1a95 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:41.257817 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dd4cfcf6-a593-42ea-9a3e-eb842f6d1a95 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:41.258297 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dd4cfcf6-a593-42ea-9a3e-eb842f6d1a95 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:41.258730 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dd4cfcf6-a593-42ea-9a3e-eb842f6d1a95 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:41.259417 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dd4cfcf6-a593-42ea-9a3e-eb842f6d1a95 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:41.259894 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dd4cfcf6-a593-42ea-9a3e-eb842f6d1a95 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:41.260322 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dd4cfcf6-a593-42ea-9a3e-eb842f6d1a95 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:41.388632 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-dd4cfcf6-a593-42ea-9a3e-eb842f6d1a95 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:04:41.397410 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-dd4cfcf6-a593-42ea-9a3e-eb842f6d1a95 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e" status: 200 len: 1366 microversion: 2.1 time: 0.155443 Aug 31 13:04:41.398005 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 250/518] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:04:41 2022] GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:04:42.422218 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-10778521-b59e-4fed-84df-b3305ba11d76 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:04:42.423111 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-10778521-b59e-4fed-84df-b3305ba11d76 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:42.431070 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-10778521-b59e-4fed-84df-b3305ba11d76 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:42.431549 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-10778521-b59e-4fed-84df-b3305ba11d76 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:42.432021 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-10778521-b59e-4fed-84df-b3305ba11d76 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:42.432714 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-10778521-b59e-4fed-84df-b3305ba11d76 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:42.433161 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-10778521-b59e-4fed-84df-b3305ba11d76 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:42.433579 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-10778521-b59e-4fed-84df-b3305ba11d76 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:42.564818 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-10778521-b59e-4fed-84df-b3305ba11d76 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:04:42.573015 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-10778521-b59e-4fed-84df-b3305ba11d76 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e" status: 200 len: 1366 microversion: 2.1 time: 0.157397 Aug 31 13:04:42.573604 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 269/519] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:04:42 2022] GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:04:43.596570 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-03c50624-3ab5-4ee5-8097-5a9021235586 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:04:43.597150 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-03c50624-3ab5-4ee5-8097-5a9021235586 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:43.610125 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-03c50624-3ab5-4ee5-8097-5a9021235586 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:43.610822 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-03c50624-3ab5-4ee5-8097-5a9021235586 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:43.611471 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-03c50624-3ab5-4ee5-8097-5a9021235586 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:43.612569 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-03c50624-3ab5-4ee5-8097-5a9021235586 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:43.613230 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-03c50624-3ab5-4ee5-8097-5a9021235586 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:43.613876 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-03c50624-3ab5-4ee5-8097-5a9021235586 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:43.750197 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-7f189f92-4f13-4e67-b5c3-388f0a0d4f1f tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:04:43.750731 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-7f189f92-4f13-4e67-b5c3-388f0a0d4f1f tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: 93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:43.754951 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-03c50624-3ab5-4ee5-8097-5a9021235586 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:04:43.758052 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7f189f92-4f13-4e67-b5c3-388f0a0d4f1f tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:43.758536 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7f189f92-4f13-4e67-b5c3-388f0a0d4f1f tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:43.758969 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7f189f92-4f13-4e67-b5c3-388f0a0d4f1f tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:43.759660 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7f189f92-4f13-4e67-b5c3-388f0a0d4f1f tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:43.760140 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7f189f92-4f13-4e67-b5c3-388f0a0d4f1f tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:43.760560 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7f189f92-4f13-4e67-b5c3-388f0a0d4f1f tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:43.763211 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-03c50624-3ab5-4ee5-8097-5a9021235586 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e" status: 200 len: 1366 microversion: 2.1 time: 0.172611 Aug 31 13:04:43.763789 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 251/520] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:04:43 2022] GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:04:43.887116 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.objects.instance [None req-7f189f92-4f13-4e67-b5c3-388f0a0d4f1f tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lazy-loading 'services' on Instance uuid 93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2 {{(pid=120704) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 13:04:44.018625 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-7f189f92-4f13-4e67-b5c3-388f0a0d4f1f tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "DELETE /compute/v2.1/servers/93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2/os-volume_attachments/93f029fb-b70c-4c19-8f56-7c5688cd7816" status: 202 len: 0 microversion: 2.1 time: 0.271844 Aug 31 13:04:44.019829 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 270/521] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 31 13:04:43 2022] DELETE /compute/v2.1/servers/93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2/os-volume_attachments/93f029fb-b70c-4c19-8f56-7c5688cd7816 => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 13:04:44.788531 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-1c34557b-c705-4bd2-bcec-53a1861c9a87 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:04:44.789543 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-1c34557b-c705-4bd2-bcec-53a1861c9a87 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:44.800536 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1c34557b-c705-4bd2-bcec-53a1861c9a87 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:44.801260 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1c34557b-c705-4bd2-bcec-53a1861c9a87 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:44.801690 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1c34557b-c705-4bd2-bcec-53a1861c9a87 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:44.802381 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1c34557b-c705-4bd2-bcec-53a1861c9a87 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:44.802818 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1c34557b-c705-4bd2-bcec-53a1861c9a87 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:44.803232 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1c34557b-c705-4bd2-bcec-53a1861c9a87 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:44.948842 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-1c34557b-c705-4bd2-bcec-53a1861c9a87 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:04:44.957034 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-1c34557b-c705-4bd2-bcec-53a1861c9a87 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e" status: 200 len: 1366 microversion: 2.1 time: 0.175334 Aug 31 13:04:44.957613 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 252/522] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:04:44 2022] GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:04:45.672808 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-c152ea9d-9866-4687-a8a4-cf597d0b7f35 req-ab7c4644-a8e4-406c-9b79-25f84357224b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e", "name": "network-vif-plugged", "status": "completed", "tag": "0223c49a-2ae0-45b1-8627-a290b23cfabb"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:04:45.683652 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-c152ea9d-9866-4687-a8a4-cf597d0b7f35 req-ab7c4644-a8e4-406c-9b79-25f84357224b service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:45.684165 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-c152ea9d-9866-4687-a8a4-cf597d0b7f35 req-ab7c4644-a8e4-406c-9b79-25f84357224b service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:45.684590 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-c152ea9d-9866-4687-a8a4-cf597d0b7f35 req-ab7c4644-a8e4-406c-9b79-25f84357224b service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:45.697425 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-c152ea9d-9866-4687-a8a4-cf597d0b7f35 req-ab7c4644-a8e4-406c-9b79-25f84357224b service nova] Creating event network-vif-plugged:0223c49a-2ae0-45b1-8627-a290b23cfabb for instance ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e on hv-cinder-85442 Aug 31 13:04:45.702281 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-c152ea9d-9866-4687-a8a4-cf597d0b7f35 req-ab7c4644-a8e4-406c-9b79-25f84357224b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034048 Aug 31 13:04:45.702880 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 271/523] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:04:45.978108 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-55d3ce39-cc2e-4d3c-a98d-db71d41422f9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:04:45.978733 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-55d3ce39-cc2e-4d3c-a98d-db71d41422f9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:45.985408 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-55d3ce39-cc2e-4d3c-a98d-db71d41422f9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:45.985825 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-55d3ce39-cc2e-4d3c-a98d-db71d41422f9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:45.986256 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-55d3ce39-cc2e-4d3c-a98d-db71d41422f9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:45.986941 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-55d3ce39-cc2e-4d3c-a98d-db71d41422f9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:45.987385 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-55d3ce39-cc2e-4d3c-a98d-db71d41422f9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:45.987795 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-55d3ce39-cc2e-4d3c-a98d-db71d41422f9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:46.116203 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-55d3ce39-cc2e-4d3c-a98d-db71d41422f9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:04:46.124255 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-55d3ce39-cc2e-4d3c-a98d-db71d41422f9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e" status: 200 len: 1366 microversion: 2.1 time: 0.150160 Aug 31 13:04:46.124841 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 253/524] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:04:45 2022] GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:04:46.215485 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-f26a3d9f-3462-43fc-905b-5d3a6d9cd2f6 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:04:46.216116 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-f26a3d9f-3462-43fc-905b-5d3a6d9cd2f6 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: 93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:46.224878 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f26a3d9f-3462-43fc-905b-5d3a6d9cd2f6 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:46.225511 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f26a3d9f-3462-43fc-905b-5d3a6d9cd2f6 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:46.226078 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f26a3d9f-3462-43fc-905b-5d3a6d9cd2f6 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:46.227315 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f26a3d9f-3462-43fc-905b-5d3a6d9cd2f6 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:46.228016 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f26a3d9f-3462-43fc-905b-5d3a6d9cd2f6 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:46.228623 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f26a3d9f-3462-43fc-905b-5d3a6d9cd2f6 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:46.257351 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-f26a3d9f-3462-43fc-905b-5d3a6d9cd2f6 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: 93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2] Going to try to terminate instance {{(pid=120704) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 13:04:46.338875 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-f26a3d9f-3462-43fc-905b-5d3a6d9cd2f6 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "DELETE /compute/v2.1/servers/93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2" status: 204 len: 0 microversion: 2.1 time: 0.127412 Aug 31 13:04:46.339453 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 272/525] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 31 13:04:46 2022] DELETE /compute/v2.1/servers/93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:04:46.347837 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-0fb577b1-075b-4c0e-9edb-6c653b36d874 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:04:46.348446 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-0fb577b1-075b-4c0e-9edb-6c653b36d874 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: 93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:46.354665 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0fb577b1-075b-4c0e-9edb-6c653b36d874 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:46.355139 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0fb577b1-075b-4c0e-9edb-6c653b36d874 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:46.355537 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0fb577b1-075b-4c0e-9edb-6c653b36d874 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:46.356254 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0fb577b1-075b-4c0e-9edb-6c653b36d874 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:46.356694 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0fb577b1-075b-4c0e-9edb-6c653b36d874 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:46.357107 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0fb577b1-075b-4c0e-9edb-6c653b36d874 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:46.492673 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-0fb577b1-075b-4c0e-9edb-6c653b36d874 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf155bc9925646f59e92f597782a8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c401f76027848f0980f470af73e4473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:04:46.504521 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-0fb577b1-075b-4c0e-9edb-6c653b36d874 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "GET /compute/v2.1/servers/93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2" status: 200 len: 1513 microversion: 2.1 time: 0.160631 Aug 31 13:04:46.505095 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 254/526] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:04:46 2022] GET /compute/v2.1/servers/93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:04:47.148234 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-787b1a55-9eb2-404e-9ed3-137bbadc95f7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:04:47.148919 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-787b1a55-9eb2-404e-9ed3-137bbadc95f7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:47.155854 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-787b1a55-9eb2-404e-9ed3-137bbadc95f7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:47.156326 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-787b1a55-9eb2-404e-9ed3-137bbadc95f7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:47.156755 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-787b1a55-9eb2-404e-9ed3-137bbadc95f7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:47.157438 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-787b1a55-9eb2-404e-9ed3-137bbadc95f7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:47.157881 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-787b1a55-9eb2-404e-9ed3-137bbadc95f7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:47.158296 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-787b1a55-9eb2-404e-9ed3-137bbadc95f7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:47.303764 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-787b1a55-9eb2-404e-9ed3-137bbadc95f7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:04:47.312167 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-787b1a55-9eb2-404e-9ed3-137bbadc95f7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e" status: 200 len: 1366 microversion: 2.1 time: 0.169015 Aug 31 13:04:47.312749 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 273/527] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:04:47 2022] GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:04:47.529767 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-9a1f8168-4209-402a-9e2d-d0353d3488f8 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:04:47.530593 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-9a1f8168-4209-402a-9e2d-d0353d3488f8 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: 93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:47.541818 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9a1f8168-4209-402a-9e2d-d0353d3488f8 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:47.542606 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9a1f8168-4209-402a-9e2d-d0353d3488f8 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:47.543323 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9a1f8168-4209-402a-9e2d-d0353d3488f8 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:47.544516 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9a1f8168-4209-402a-9e2d-d0353d3488f8 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:47.545257 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9a1f8168-4209-402a-9e2d-d0353d3488f8 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:47.545953 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9a1f8168-4209-402a-9e2d-d0353d3488f8 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:47.691412 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-9a1f8168-4209-402a-9e2d-d0353d3488f8 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf155bc9925646f59e92f597782a8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c401f76027848f0980f470af73e4473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:04:47.699601 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-9a1f8168-4209-402a-9e2d-d0353d3488f8 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "GET /compute/v2.1/servers/93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2" status: 200 len: 1513 microversion: 2.1 time: 0.176497 Aug 31 13:04:47.700225 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 255/528] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:04:47 2022] GET /compute/v2.1/servers/93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2 => generated 1513 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:04:48.337930 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-f80fa754-59ad-4b69-8881-ca64d32a7284 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:04:48.340046 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-f80fa754-59ad-4b69-8881-ca64d32a7284 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:48.351018 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f80fa754-59ad-4b69-8881-ca64d32a7284 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:48.351865 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f80fa754-59ad-4b69-8881-ca64d32a7284 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:48.352642 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f80fa754-59ad-4b69-8881-ca64d32a7284 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:48.353771 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f80fa754-59ad-4b69-8881-ca64d32a7284 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:48.354513 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f80fa754-59ad-4b69-8881-ca64d32a7284 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:48.355218 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f80fa754-59ad-4b69-8881-ca64d32a7284 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:48.496243 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-f80fa754-59ad-4b69-8881-ca64d32a7284 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:04:48.508040 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-f80fa754-59ad-4b69-8881-ca64d32a7284 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e" status: 200 len: 1366 microversion: 2.1 time: 0.176458 Aug 31 13:04:48.508799 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 274/529] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:04:48 2022] GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:04:48.723130 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-05652367-33bb-4433-8440-65bb82aa2a40 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:04:48.723785 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-05652367-33bb-4433-8440-65bb82aa2a40 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: 93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:48.731653 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-05652367-33bb-4433-8440-65bb82aa2a40 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:48.732255 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-05652367-33bb-4433-8440-65bb82aa2a40 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:48.732743 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-05652367-33bb-4433-8440-65bb82aa2a40 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:48.733524 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-05652367-33bb-4433-8440-65bb82aa2a40 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:48.734009 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-05652367-33bb-4433-8440-65bb82aa2a40 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:48.734483 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-05652367-33bb-4433-8440-65bb82aa2a40 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:48.867462 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-05652367-33bb-4433-8440-65bb82aa2a40 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf155bc9925646f59e92f597782a8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c401f76027848f0980f470af73e4473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:04:48.875882 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-05652367-33bb-4433-8440-65bb82aa2a40 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "GET /compute/v2.1/servers/93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2" status: 200 len: 1513 microversion: 2.1 time: 0.158872 Aug 31 13:04:48.876475 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 256/530] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:04:48 2022] GET /compute/v2.1/servers/93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:04:49.536909 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-10538d77-571a-48d8-9b00-852979862a56 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:04:49.537651 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-10538d77-571a-48d8-9b00-852979862a56 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:49.546770 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-10538d77-571a-48d8-9b00-852979862a56 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:49.547389 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-10538d77-571a-48d8-9b00-852979862a56 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:49.547997 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-10538d77-571a-48d8-9b00-852979862a56 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:49.548887 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-10538d77-571a-48d8-9b00-852979862a56 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:49.549462 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-10538d77-571a-48d8-9b00-852979862a56 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:49.550005 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-10538d77-571a-48d8-9b00-852979862a56 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:49.706571 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-10538d77-571a-48d8-9b00-852979862a56 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:04:49.719246 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-10538d77-571a-48d8-9b00-852979862a56 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e" status: 200 len: 1366 microversion: 2.1 time: 0.188551 Aug 31 13:04:49.720055 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 275/531] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:04:49 2022] GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:04:49.897485 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-58c84c9e-4e3b-42f2-97bd-3bee5a94276e tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:04:49.898821 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-58c84c9e-4e3b-42f2-97bd-3bee5a94276e tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: 93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:49.905770 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-58c84c9e-4e3b-42f2-97bd-3bee5a94276e tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:49.906240 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-58c84c9e-4e3b-42f2-97bd-3bee5a94276e tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:49.906689 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-58c84c9e-4e3b-42f2-97bd-3bee5a94276e tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:49.907844 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-58c84c9e-4e3b-42f2-97bd-3bee5a94276e tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:49.907844 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-58c84c9e-4e3b-42f2-97bd-3bee5a94276e tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:49.908265 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-58c84c9e-4e3b-42f2-97bd-3bee5a94276e tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:50.043527 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-58c84c9e-4e3b-42f2-97bd-3bee5a94276e tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf155bc9925646f59e92f597782a8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c401f76027848f0980f470af73e4473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:04:50.051932 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-58c84c9e-4e3b-42f2-97bd-3bee5a94276e tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "GET /compute/v2.1/servers/93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2" status: 200 len: 1513 microversion: 2.1 time: 0.158541 Aug 31 13:04:50.052512 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 257/532] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:04:49 2022] GET /compute/v2.1/servers/93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:04:50.256542 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-ad3843a7-3aab-4f17-bb3b-357f2be051c1 req-19545a5a-2765-473c-ab48-ccbb273e1216 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2", "name": "network-vif-deleted", "tag": "59fdf56b-6c3e-46f9-aac8-f378b6df70d4"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:04:50.266126 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-ad3843a7-3aab-4f17-bb3b-357f2be051c1 req-19545a5a-2765-473c-ab48-ccbb273e1216 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:50.266592 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-ad3843a7-3aab-4f17-bb3b-357f2be051c1 req-19545a5a-2765-473c-ab48-ccbb273e1216 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:50.267017 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-ad3843a7-3aab-4f17-bb3b-357f2be051c1 req-19545a5a-2765-473c-ab48-ccbb273e1216 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:50.280658 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-ad3843a7-3aab-4f17-bb3b-357f2be051c1 req-19545a5a-2765-473c-ab48-ccbb273e1216 service nova] Creating event network-vif-deleted:59fdf56b-6c3e-46f9-aac8-f378b6df70d4 for instance 93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2 on hv-cinder-85442 Aug 31 13:04:50.286439 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-ad3843a7-3aab-4f17-bb3b-357f2be051c1 req-19545a5a-2765-473c-ab48-ccbb273e1216 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090324 Aug 31 13:04:50.287042 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 276/533] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:04:50.740826 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b022789f-fcfc-46ce-a7f2-413461f8f22b tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:04:50.741457 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b022789f-fcfc-46ce-a7f2-413461f8f22b tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:50.747578 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b022789f-fcfc-46ce-a7f2-413461f8f22b tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:50.748100 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b022789f-fcfc-46ce-a7f2-413461f8f22b tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:50.748528 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b022789f-fcfc-46ce-a7f2-413461f8f22b tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:50.749218 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b022789f-fcfc-46ce-a7f2-413461f8f22b tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:50.749661 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b022789f-fcfc-46ce-a7f2-413461f8f22b tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:50.750074 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b022789f-fcfc-46ce-a7f2-413461f8f22b tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:50.883505 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-b022789f-fcfc-46ce-a7f2-413461f8f22b tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:04:50.892215 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b022789f-fcfc-46ce-a7f2-413461f8f22b tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e" status: 200 len: 1555 microversion: 2.1 time: 0.155379 Aug 31 13:04:50.892795 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 258/534] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:04:50 2022] GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:04:50.913069 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-8f106ddb-08b9-4998-8f70-0953ea112d3d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:04:50.913907 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-8f106ddb-08b9-4998-8f70-0953ea112d3d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:50.920576 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8f106ddb-08b9-4998-8f70-0953ea112d3d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:50.921046 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8f106ddb-08b9-4998-8f70-0953ea112d3d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:50.922098 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8f106ddb-08b9-4998-8f70-0953ea112d3d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:50.922790 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8f106ddb-08b9-4998-8f70-0953ea112d3d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:50.923224 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8f106ddb-08b9-4998-8f70-0953ea112d3d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:50.923930 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8f106ddb-08b9-4998-8f70-0953ea112d3d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:51.007206 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-8f106ddb-08b9-4998-8f70-0953ea112d3d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098615 Aug 31 13:04:51.007919 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 277/535] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 31 13:04:50 2022] GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:04:51.072790 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-67c87042-7ca6-4d88-97fe-f96416d016fd tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:04:51.073518 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-67c87042-7ca6-4d88-97fe-f96416d016fd tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: 93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:51.080221 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-67c87042-7ca6-4d88-97fe-f96416d016fd tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:51.080764 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-67c87042-7ca6-4d88-97fe-f96416d016fd tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:51.081249 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-67c87042-7ca6-4d88-97fe-f96416d016fd tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:51.081967 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-67c87042-7ca6-4d88-97fe-f96416d016fd tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:51.082400 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-67c87042-7ca6-4d88-97fe-f96416d016fd tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:51.082815 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-67c87042-7ca6-4d88-97fe-f96416d016fd tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:51.114288 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-67c87042-7ca6-4d88-97fe-f96416d016fd tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:51.114756 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-67c87042-7ca6-4d88-97fe-f96416d016fd tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:51.115189 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-67c87042-7ca6-4d88-97fe-f96416d016fd tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:51.115606 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.objects.instance [None req-67c87042-7ca6-4d88-97fe-f96416d016fd tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lazy-loading 'fault' on Instance uuid 93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2 {{(pid=120705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 13:04:51.156506 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-67c87042-7ca6-4d88-97fe-f96416d016fd tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf155bc9925646f59e92f597782a8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c401f76027848f0980f470af73e4473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:04:51.164919 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-67c87042-7ca6-4d88-97fe-f96416d016fd tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "GET /compute/v2.1/servers/93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2" status: 200 len: 1308 microversion: 2.1 time: 0.095978 Aug 31 13:04:51.165487 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 259/536] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:04:51 2022] GET /compute/v2.1/servers/93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2 => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:04:52.188152 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-0a58b73b-0c2a-4aae-bea5-cc78940a33c0 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:04:52.189885 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-0a58b73b-0c2a-4aae-bea5-cc78940a33c0 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] [instance: 93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:04:52.196095 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0a58b73b-0c2a-4aae-bea5-cc78940a33c0 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:52.196664 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0a58b73b-0c2a-4aae-bea5-cc78940a33c0 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:52.197160 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0a58b73b-0c2a-4aae-bea5-cc78940a33c0 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:52.197945 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0a58b73b-0c2a-4aae-bea5-cc78940a33c0 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:52.198397 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0a58b73b-0c2a-4aae-bea5-cc78940a33c0 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:52.198810 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0a58b73b-0c2a-4aae-bea5-cc78940a33c0 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:52.214112 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.wsgi [None req-0a58b73b-0c2a-4aae-bea5-cc78940a33c0 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] HTTP exception thrown: Instance 93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2 could not be found. Aug 31 13:04:52.215780 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-0a58b73b-0c2a-4aae-bea5-cc78940a33c0 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Request method failure captured: Aug 31 13:04:52.215780 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: request: GET /compute/v2.1/servers/93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2 HTTP/1.1 Aug 31 13:04:52.215780 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept: application/json Aug 31 13:04:52.215780 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept-Encoding: identity Aug 31 13:04:52.215780 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Connection: close Aug 31 13:04:52.215780 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Length: 0 Aug 31 13:04:52.215780 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Type: application/json Aug 31 13:04:52.215780 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Host: 10.222.0.58 Aug 31 13:04:52.215780 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Openstack-System-Scope: None Aug 31 13:04:52.215780 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: User-Agent: python-urllib3/1.26.12 Aug 31 13:04:52.215780 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Auth-Token: gAAAAABjD1vFxan8-kkdMPdlz4LEpJzwkXvPBfF8qzegPKP95q_RPeSv7PmzQx02DhHinKDqsr4mN-oF1XCCD2WkGLCl97pP8DCp1d5pPhuXs_4P_tAfVowDxauw_z-x7CUlh0VotGc7bGvCqwap2B4zmodJbBYIiLYgPWbH98qP9iFdS7M703I Aug 31 13:04:52.215780 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Id: None Aug 31 13:04:52.215780 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Name: None Aug 31 13:04:52.215780 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Identity-Status: Confirmed Aug 31 13:04:52.215780 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Is-Admin-Project: True Aug 31 13:04:52.215780 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Id: default Aug 31 13:04:52.215780 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Name: Default Aug 31 13:04:52.215780 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Id: 7c401f76027848f0980f470af73e4473 Aug 31 13:04:52.215780 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Name: tempest-VolumesSnapshotTestJSON-683666343 Aug 31 13:04:52.215780 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Role: member,reader Aug 31 13:04:52.215780 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Roles: member,reader Aug 31 13:04:52.217379 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7c401f76027848f0980f470af73e4473"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7c401f76027848f0980f470af73e4473"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7c401f76027848f0980f470af73e4473"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7c401f76027848f0980f470af73e4473"}]}] Aug 31 13:04:52.217379 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant: tempest-VolumesSnapshotTestJSON-683666343 Aug 31 13:04:52.217379 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Id: 7c401f76027848f0980f470af73e4473 Aug 31 13:04:52.217379 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-683666343 Aug 31 13:04:52.217379 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User: tempest-VolumesSnapshotTestJSON-683666343-project Aug 31 13:04:52.217379 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Id: default Aug 31 13:04:52.217379 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Name: Default Aug 31 13:04:52.217379 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Id: bf155bc9925646f59e92f597782a8881 Aug 31 13:04:52.217379 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Name: tempest-VolumesSnapshotTestJSON-683666343-project Aug 31 13:04:52.217379 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: method: > Aug 31 13:04:52.217379 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: exception: Instance 93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2 could not be found. Aug 31 13:04:52.217379 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: action_args: {'id': '93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2'} Aug 31 13:04:52.218185 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:04:52.218185 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:04:52.218185 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 13:04:52.218185 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 13:04:52.218185 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 13:04:52.218185 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 13:04:52.218185 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 13:04:52.218185 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 13:04:52.218185 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 13:04:52.218185 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 13:04:52.218185 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2 could not be found. Aug 31 13:04:52.218185 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:04:52.218185 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:04:52.218185 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:04:52.218185 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:04:52.218185 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:04:52.218185 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:04:52.218185 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:04:52.218185 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:04:52.218185 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:04:52.219741 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:04:52.219741 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 13:04:52.219741 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 13:04:52.219741 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 13:04:52.219741 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 13:04:52.219741 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 13:04:52.219741 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 13:04:52.219741 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2 could not be found. Aug 31 13:04:52.219741 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:04:52.219741 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:04:52.219741 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:04:52.219741 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:04:52.219741 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:04:52.219741 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:04:52.219741 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:04:52.219741 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:04:52.219741 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2 could not be found. Aug 31 13:04:52.219741 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:04:52.220988 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-0a58b73b-0c2a-4aae-bea5-cc78940a33c0 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] Returning 404 to user: Instance 93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2 could not be found. {{(pid=120704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:04:52.220988 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-0a58b73b-0c2a-4aae-bea5-cc78940a33c0 tempest-VolumesSnapshotTestJSON-683666343 tempest-VolumesSnapshotTestJSON-683666343-project] 10.222.0.58 "GET /compute/v2.1/servers/93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2" status: 404 len: 111 microversion: 2.1 time: 0.034398 Aug 31 13:04:52.220988 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 278/537] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:04:52 2022] GET /compute/v2.1/servers/93851b6c-1fcb-4767-9c4c-58e1dd6dfcb2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:04:52.303400 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-fc17288e-757c-47b0-b61b-dcb1c710d582 req-d2fb345f-fda5-4f86-9699-dabfc543562b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e", "tag": "0223c49a-2ae0-45b1-8627-a290b23cfabb"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:04:52.313393 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-fc17288e-757c-47b0-b61b-dcb1c710d582 req-d2fb345f-fda5-4f86-9699-dabfc543562b service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:04:52.314022 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-fc17288e-757c-47b0-b61b-dcb1c710d582 req-d2fb345f-fda5-4f86-9699-dabfc543562b service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:04:52.314535 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-fc17288e-757c-47b0-b61b-dcb1c710d582 req-d2fb345f-fda5-4f86-9699-dabfc543562b service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:04:52.326095 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-fc17288e-757c-47b0-b61b-dcb1c710d582 req-d2fb345f-fda5-4f86-9699-dabfc543562b service nova] Creating event network-changed:0223c49a-2ae0-45b1-8627-a290b23cfabb for instance ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e on hv-cinder-85442 Aug 31 13:04:52.331720 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-fc17288e-757c-47b0-b61b-dcb1c710d582 req-d2fb345f-fda5-4f86-9699-dabfc543562b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032145 Aug 31 13:04:52.332793 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 260/538] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:05:17.409912 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:17.410652 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell1:SELECT=74,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:17.520275 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-0382ac80-cebe-4f83-b524-e528132ad1d9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b06416ea-a4ec-4677-a342-64ed4bd5df00"}} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:05:17.522598 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-0382ac80-cebe-4f83-b524-e528132ad1d9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:17.528921 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0382ac80-cebe-4f83-b524-e528132ad1d9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:17.529370 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0382ac80-cebe-4f83-b524-e528132ad1d9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:17.529836 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0382ac80-cebe-4f83-b524-e528132ad1d9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:17.530526 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0382ac80-cebe-4f83-b524-e528132ad1d9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:17.530969 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0382ac80-cebe-4f83-b524-e528132ad1d9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:17.531394 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0382ac80-cebe-4f83-b524-e528132ad1d9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:17.848031 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-0382ac80-cebe-4f83-b524-e528132ad1d9 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "POST /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.438484 Aug 31 13:05:17.848031 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 279/539] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 31 13:05:17 2022] POST /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec/os-volume_attachments => generated 194 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:05:25.702599 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=29 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:25.703419 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=81 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:25.947479 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-83d61e84-f11d-4bae-bdd1-96860aae40b6 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:05:25.948122 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-83d61e84-f11d-4bae-bdd1-96860aae40b6 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:25.954391 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-83d61e84-f11d-4bae-bdd1-96860aae40b6 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:25.954863 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-83d61e84-f11d-4bae-bdd1-96860aae40b6 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:25.955292 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-83d61e84-f11d-4bae-bdd1-96860aae40b6 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:25.956010 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-83d61e84-f11d-4bae-bdd1-96860aae40b6 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:25.956514 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-83d61e84-f11d-4bae-bdd1-96860aae40b6 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:25.956933 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-83d61e84-f11d-4bae-bdd1-96860aae40b6 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:25.979674 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.objects.instance [None req-83d61e84-f11d-4bae-bdd1-96860aae40b6 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lazy-loading 'flavor' on Instance uuid 9e792077-8a21-48f8-8f65-ce1a4aae8c0a {{(pid=120705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 13:05:26.059323 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-6cfbfa8e-4866-4fae-9742-8048221d245a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:26.059996 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-6cfbfa8e-4866-4fae-9742-8048221d245a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:26.067028 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6cfbfa8e-4866-4fae-9742-8048221d245a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:26.067883 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6cfbfa8e-4866-4fae-9742-8048221d245a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:26.068474 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6cfbfa8e-4866-4fae-9742-8048221d245a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:26.069318 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6cfbfa8e-4866-4fae-9742-8048221d245a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:26.069754 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6cfbfa8e-4866-4fae-9742-8048221d245a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:26.070320 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6cfbfa8e-4866-4fae-9742-8048221d245a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:26.106649 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-83d61e84-f11d-4bae-bdd1-96860aae40b6 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "POST /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a/action" status: 202 len: 0 microversion: 2.1 time: 0.405707 Aug 31 13:05:26.110501 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 261/540] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 31 13:05:25 2022] POST /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a/action => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:05:26.116604 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-a0117cf7-2eac-481a-90ad-9bad03652028 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:26.117384 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-a0117cf7-2eac-481a-90ad-9bad03652028 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:26.124598 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a0117cf7-2eac-481a-90ad-9bad03652028 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:26.125237 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a0117cf7-2eac-481a-90ad-9bad03652028 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:26.125661 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a0117cf7-2eac-481a-90ad-9bad03652028 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:26.126348 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a0117cf7-2eac-481a-90ad-9bad03652028 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:26.126824 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a0117cf7-2eac-481a-90ad-9bad03652028 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:26.127191 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a0117cf7-2eac-481a-90ad-9bad03652028 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:26.155199 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.objects.instance [None req-6cfbfa8e-4866-4fae-9742-8048221d245a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lazy-loading 'services' on Instance uuid 48f08cc0-15cb-4884-960b-a96396a0d4bf {{(pid=120704) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 13:05:26.230812 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-6cfbfa8e-4866-4fae-9742-8048221d245a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "DELETE /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf/os-volume_attachments/52d6a498-9f63-4726-af4b-04bc4407516f" status: 202 len: 0 microversion: 2.1 time: 0.297879 Aug 31 13:05:26.231420 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 280/541] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 31 13:05:25 2022] DELETE /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf/os-volume_attachments/52d6a498-9f63-4726-af4b-04bc4407516f => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 13:05:26.274047 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-a0117cf7-2eac-481a-90ad-9bad03652028 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:26.284948 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-a0117cf7-2eac-481a-90ad-9bad03652028 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1568 microversion: 2.1 time: 0.172767 Aug 31 13:05:26.285507 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 262/542] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:26 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:05:26.500006 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-3eadd8bf-9d60-4994-b356-f3e879dea46a tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:05:26.502365 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-3eadd8bf-9d60-4994-b356-f3e879dea46a tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:26.509319 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3eadd8bf-9d60-4994-b356-f3e879dea46a tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:26.509786 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3eadd8bf-9d60-4994-b356-f3e879dea46a tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:26.510201 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3eadd8bf-9d60-4994-b356-f3e879dea46a tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:26.510904 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3eadd8bf-9d60-4994-b356-f3e879dea46a tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:26.511341 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3eadd8bf-9d60-4994-b356-f3e879dea46a tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:26.511749 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3eadd8bf-9d60-4994-b356-f3e879dea46a tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:26.535046 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.objects.instance [None req-3eadd8bf-9d60-4994-b356-f3e879dea46a tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lazy-loading 'flavor' on Instance uuid dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec {{(pid=120704) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 13:05:26.663910 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-3eadd8bf-9d60-4994-b356-f3e879dea46a tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "POST /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec/action" status: 200 len: 32 microversion: 2.1 time: 0.168653 Aug 31 13:05:26.664435 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 281/543] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 31 13:05:26 2022] POST /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec/action => generated 32 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 13:05:26.673874 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e8192a2d-6626-4613-accc-58e6a176c9ae tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:26.674471 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e8192a2d-6626-4613-accc-58e6a176c9ae tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:26.680693 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e8192a2d-6626-4613-accc-58e6a176c9ae tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:26.681165 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e8192a2d-6626-4613-accc-58e6a176c9ae tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:26.681593 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e8192a2d-6626-4613-accc-58e6a176c9ae tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:26.682300 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e8192a2d-6626-4613-accc-58e6a176c9ae tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:26.682737 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e8192a2d-6626-4613-accc-58e6a176c9ae tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:26.683147 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e8192a2d-6626-4613-accc-58e6a176c9ae tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:26.813410 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e8192a2d-6626-4613-accc-58e6a176c9ae tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:26.821868 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e8192a2d-6626-4613-accc-58e6a176c9ae tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1734 microversion: 2.1 time: 0.151857 Aug 31 13:05:26.822468 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 263/544] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:26 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:27.313362 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-3797a671-aea5-4140-a590-a15b4630828d tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:27.314304 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-3797a671-aea5-4140-a590-a15b4630828d tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:27.333968 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3797a671-aea5-4140-a590-a15b4630828d tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:27.334670 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3797a671-aea5-4140-a590-a15b4630828d tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:27.335118 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3797a671-aea5-4140-a590-a15b4630828d tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:27.336047 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3797a671-aea5-4140-a590-a15b4630828d tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:27.336806 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3797a671-aea5-4140-a590-a15b4630828d tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:27.337444 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3797a671-aea5-4140-a590-a15b4630828d tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:27.477211 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-3797a671-aea5-4140-a590-a15b4630828d tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:27.485343 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-3797a671-aea5-4140-a590-a15b4630828d tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1568 microversion: 2.1 time: 0.182583 Aug 31 13:05:27.485919 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 282/545] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:27 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:27.842990 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-d1228c27-37a7-4581-9b7a-d8490eb2436f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:27.843806 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-d1228c27-37a7-4581-9b7a-d8490eb2436f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:27.851147 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d1228c27-37a7-4581-9b7a-d8490eb2436f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:27.851623 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d1228c27-37a7-4581-9b7a-d8490eb2436f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:27.852078 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d1228c27-37a7-4581-9b7a-d8490eb2436f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:27.852759 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d1228c27-37a7-4581-9b7a-d8490eb2436f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:27.853207 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d1228c27-37a7-4581-9b7a-d8490eb2436f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:27.853614 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d1228c27-37a7-4581-9b7a-d8490eb2436f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:28.024619 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-d1228c27-37a7-4581-9b7a-d8490eb2436f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:28.037569 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-d1228c27-37a7-4581-9b7a-d8490eb2436f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1734 microversion: 2.1 time: 0.198322 Aug 31 13:05:28.038277 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 264/546] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:27 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1734 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:28.432126 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-c4068d15-4b40-4159-93d0-b7e4f405f837 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:05:28.439653 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c4068d15-4b40-4159-93d0-b7e4f405f837 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:28.440130 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c4068d15-4b40-4159-93d0-b7e4f405f837 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:28.440626 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c4068d15-4b40-4159-93d0-b7e4f405f837 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:28.463610 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-c4068d15-4b40-4159-93d0-b7e4f405f837 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Going to try to stop instance {{(pid=120704) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 13:05:28.507116 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-fbe27fee-66c4-401a-b681-008435dd6124 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:28.507649 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-fbe27fee-66c4-401a-b681-008435dd6124 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:28.512481 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-c4068d15-4b40-4159-93d0-b7e4f405f837 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "POST /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf/action" status: 202 len: 0 microversion: 2.1 time: 0.084253 Aug 31 13:05:28.513094 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 283/547] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 31 13:05:28 2022] POST /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:05:28.515012 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fbe27fee-66c4-401a-b681-008435dd6124 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:28.515478 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fbe27fee-66c4-401a-b681-008435dd6124 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:28.515922 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fbe27fee-66c4-401a-b681-008435dd6124 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:28.517197 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fbe27fee-66c4-401a-b681-008435dd6124 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:28.517648 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fbe27fee-66c4-401a-b681-008435dd6124 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:28.518241 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fbe27fee-66c4-401a-b681-008435dd6124 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:28.522483 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-c5ca674f-b1d9-4fb9-9346-b7865a78e954 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:28.523175 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-c5ca674f-b1d9-4fb9-9346-b7865a78e954 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:28.530092 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c5ca674f-b1d9-4fb9-9346-b7865a78e954 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:28.530592 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c5ca674f-b1d9-4fb9-9346-b7865a78e954 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:28.531080 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c5ca674f-b1d9-4fb9-9346-b7865a78e954 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:28.531864 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c5ca674f-b1d9-4fb9-9346-b7865a78e954 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:28.532283 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c5ca674f-b1d9-4fb9-9346-b7865a78e954 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:28.532816 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c5ca674f-b1d9-4fb9-9346-b7865a78e954 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:28.726832 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-fbe27fee-66c4-401a-b681-008435dd6124 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:28.729934 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-c5ca674f-b1d9-4fb9-9346-b7865a78e954 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:28.734838 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-fbe27fee-66c4-401a-b681-008435dd6124 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1568 microversion: 2.1 time: 0.232100 Aug 31 13:05:28.735416 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 265/548] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:28 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1568 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:05:28.738423 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-c5ca674f-b1d9-4fb9-9346-b7865a78e954 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1678 microversion: 2.1 time: 0.220783 Aug 31 13:05:28.739012 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 284/549] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:28 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1678 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:29.062560 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-2af7604b-0de8-457f-a38b-df22096c7863 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:29.063400 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-2af7604b-0de8-457f-a38b-df22096c7863 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:29.072469 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2af7604b-0de8-457f-a38b-df22096c7863 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:29.073127 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2af7604b-0de8-457f-a38b-df22096c7863 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:29.073722 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2af7604b-0de8-457f-a38b-df22096c7863 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:29.074712 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2af7604b-0de8-457f-a38b-df22096c7863 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:29.075377 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2af7604b-0de8-457f-a38b-df22096c7863 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:29.076051 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2af7604b-0de8-457f-a38b-df22096c7863 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:29.225604 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-2af7604b-0de8-457f-a38b-df22096c7863 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:29.238429 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-2af7604b-0de8-457f-a38b-df22096c7863 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1734 microversion: 2.1 time: 0.180879 Aug 31 13:05:29.239371 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 266/550] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:29 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1734 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:29.761075 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-4bae69a8-2c61-44d0-901b-830cca1441f1 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:29.762292 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-4bae69a8-2c61-44d0-901b-830cca1441f1 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:29.766660 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-2390bc8c-f7e1-4cde-9f07-d6aacaaf28ea tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:29.767707 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-2390bc8c-f7e1-4cde-9f07-d6aacaaf28ea tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:29.771903 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4bae69a8-2c61-44d0-901b-830cca1441f1 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:29.772381 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4bae69a8-2c61-44d0-901b-830cca1441f1 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:29.772808 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4bae69a8-2c61-44d0-901b-830cca1441f1 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:29.773487 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4bae69a8-2c61-44d0-901b-830cca1441f1 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:29.773931 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4bae69a8-2c61-44d0-901b-830cca1441f1 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:29.774341 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4bae69a8-2c61-44d0-901b-830cca1441f1 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:29.774439 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2390bc8c-f7e1-4cde-9f07-d6aacaaf28ea tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:29.774883 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2390bc8c-f7e1-4cde-9f07-d6aacaaf28ea tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:29.775315 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2390bc8c-f7e1-4cde-9f07-d6aacaaf28ea tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:29.776066 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2390bc8c-f7e1-4cde-9f07-d6aacaaf28ea tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:29.776497 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2390bc8c-f7e1-4cde-9f07-d6aacaaf28ea tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:29.776917 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2390bc8c-f7e1-4cde-9f07-d6aacaaf28ea tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:29.974043 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-4bae69a8-2c61-44d0-901b-830cca1441f1 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:29.978029 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-2390bc8c-f7e1-4cde-9f07-d6aacaaf28ea tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:29.982274 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-4bae69a8-2c61-44d0-901b-830cca1441f1 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1568 microversion: 2.1 time: 0.228106 Aug 31 13:05:29.982866 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 285/551] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:29 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:29.985927 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-2390bc8c-f7e1-4cde-9f07-d6aacaaf28ea tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1678 microversion: 2.1 time: 0.226323 Aug 31 13:05:29.986506 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 267/552] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:29 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1678 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:30.269372 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-6732d201-32af-4fe1-b565-d1f2d5a20d17 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:30.269973 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-6732d201-32af-4fe1-b565-d1f2d5a20d17 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:30.277386 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6732d201-32af-4fe1-b565-d1f2d5a20d17 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:30.277866 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6732d201-32af-4fe1-b565-d1f2d5a20d17 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:30.278296 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6732d201-32af-4fe1-b565-d1f2d5a20d17 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:30.278985 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6732d201-32af-4fe1-b565-d1f2d5a20d17 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:30.279434 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6732d201-32af-4fe1-b565-d1f2d5a20d17 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:30.279901 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6732d201-32af-4fe1-b565-d1f2d5a20d17 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:30.415437 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-6732d201-32af-4fe1-b565-d1f2d5a20d17 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:30.424007 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-6732d201-32af-4fe1-b565-d1f2d5a20d17 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1734 microversion: 2.1 time: 0.160941 Aug 31 13:05:30.424587 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 286/553] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:30 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:31.003925 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b6113bb4-489c-4b72-9128-50f9f6437fde tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:31.004456 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b6113bb4-489c-4b72-9128-50f9f6437fde tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:31.006973 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-df2a8d91-c636-4019-ba32-98240a04faa1 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:31.007579 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-df2a8d91-c636-4019-ba32-98240a04faa1 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:31.011053 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b6113bb4-489c-4b72-9128-50f9f6437fde tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:31.011545 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b6113bb4-489c-4b72-9128-50f9f6437fde tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:31.011990 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b6113bb4-489c-4b72-9128-50f9f6437fde tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:31.012683 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b6113bb4-489c-4b72-9128-50f9f6437fde tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:31.013119 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b6113bb4-489c-4b72-9128-50f9f6437fde tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:31.013555 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b6113bb4-489c-4b72-9128-50f9f6437fde tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:31.014235 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-df2a8d91-c636-4019-ba32-98240a04faa1 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:31.014711 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-df2a8d91-c636-4019-ba32-98240a04faa1 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:31.015148 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-df2a8d91-c636-4019-ba32-98240a04faa1 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:31.015833 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-df2a8d91-c636-4019-ba32-98240a04faa1 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:31.016313 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-df2a8d91-c636-4019-ba32-98240a04faa1 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:31.016731 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-df2a8d91-c636-4019-ba32-98240a04faa1 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:31.423537 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-b6113bb4-489c-4b72-9128-50f9f6437fde tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:31.427028 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-df2a8d91-c636-4019-ba32-98240a04faa1 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:31.431844 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b6113bb4-489c-4b72-9128-50f9f6437fde tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1568 microversion: 2.1 time: 0.431996 Aug 31 13:05:31.432590 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 268/554] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:30 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1568 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:31.435085 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-df2a8d91-c636-4019-ba32-98240a04faa1 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1678 microversion: 2.1 time: 0.431877 Aug 31 13:05:31.435658 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 287/555] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:31 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1678 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:31.446228 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-4a253bc4-2bc5-4568-b4cc-76f38b87f67a tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:31.446826 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-4a253bc4-2bc5-4568-b4cc-76f38b87f67a tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:31.453136 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4a253bc4-2bc5-4568-b4cc-76f38b87f67a tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:31.453619 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4a253bc4-2bc5-4568-b4cc-76f38b87f67a tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:31.454047 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4a253bc4-2bc5-4568-b4cc-76f38b87f67a tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:31.454733 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4a253bc4-2bc5-4568-b4cc-76f38b87f67a tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:31.455177 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4a253bc4-2bc5-4568-b4cc-76f38b87f67a tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:31.455597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4a253bc4-2bc5-4568-b4cc-76f38b87f67a tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:31.590051 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-4a253bc4-2bc5-4568-b4cc-76f38b87f67a tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:31.598771 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-4a253bc4-2bc5-4568-b4cc-76f38b87f67a tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1734 microversion: 2.1 time: 0.156584 Aug 31 13:05:31.599347 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 269/556] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:31 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:32.457296 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-498f1224-762e-46a0-8adf-d5cd75998878 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:32.458422 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-498f1224-762e-46a0-8adf-d5cd75998878 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:32.460197 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-fdcd564d-9624-491e-be88-3d92959875af tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:32.461340 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-fdcd564d-9624-491e-be88-3d92959875af tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:32.468624 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-498f1224-762e-46a0-8adf-d5cd75998878 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:32.469600 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-498f1224-762e-46a0-8adf-d5cd75998878 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:32.470138 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-498f1224-762e-46a0-8adf-d5cd75998878 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:32.471279 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-498f1224-762e-46a0-8adf-d5cd75998878 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:32.471987 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fdcd564d-9624-491e-be88-3d92959875af tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:32.472174 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-498f1224-762e-46a0-8adf-d5cd75998878 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:32.472554 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-498f1224-762e-46a0-8adf-d5cd75998878 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:32.472686 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fdcd564d-9624-491e-be88-3d92959875af tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:32.473032 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fdcd564d-9624-491e-be88-3d92959875af tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:32.473711 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fdcd564d-9624-491e-be88-3d92959875af tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:32.474149 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fdcd564d-9624-491e-be88-3d92959875af tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:32.474561 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fdcd564d-9624-491e-be88-3d92959875af tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:32.669076 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-498f1224-762e-46a0-8adf-d5cd75998878 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:32.673035 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-fdcd564d-9624-491e-be88-3d92959875af tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:32.677009 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-498f1224-762e-46a0-8adf-d5cd75998878 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1568 microversion: 2.1 time: 0.226254 Aug 31 13:05:32.677603 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 288/557] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:32 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1568 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:32.681293 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-fdcd564d-9624-491e-be88-3d92959875af tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1678 microversion: 2.1 time: 0.227570 Aug 31 13:05:32.682018 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 270/558] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:32 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1678 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:32.682139 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-90052f7d-699a-43c3-8fd6-9bb0cfe9ac3c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:32.682550 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-90052f7d-699a-43c3-8fd6-9bb0cfe9ac3c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:32.688551 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-90052f7d-699a-43c3-8fd6-9bb0cfe9ac3c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:32.689023 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-90052f7d-699a-43c3-8fd6-9bb0cfe9ac3c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:32.689442 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-90052f7d-699a-43c3-8fd6-9bb0cfe9ac3c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:32.690119 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-90052f7d-699a-43c3-8fd6-9bb0cfe9ac3c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:32.690554 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-90052f7d-699a-43c3-8fd6-9bb0cfe9ac3c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:32.690997 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-90052f7d-699a-43c3-8fd6-9bb0cfe9ac3c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:32.825035 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-90052f7d-699a-43c3-8fd6-9bb0cfe9ac3c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:32.833425 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-90052f7d-699a-43c3-8fd6-9bb0cfe9ac3c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1734 microversion: 2.1 time: 0.154851 Aug 31 13:05:32.833966 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 289/559] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:32 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:33.702837 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-5ee168cb-1547-40c0-b219-b2bd1e2d26c4 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:33.703763 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-5ee168cb-1547-40c0-b219-b2bd1e2d26c4 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:33.706462 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-b959e798-d433-4521-86bd-039f964d0be7 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:33.707798 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-b959e798-d433-4521-86bd-039f964d0be7 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:33.715372 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5ee168cb-1547-40c0-b219-b2bd1e2d26c4 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:33.716287 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5ee168cb-1547-40c0-b219-b2bd1e2d26c4 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:33.716979 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5ee168cb-1547-40c0-b219-b2bd1e2d26c4 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:33.718145 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5ee168cb-1547-40c0-b219-b2bd1e2d26c4 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:33.718826 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b959e798-d433-4521-86bd-039f964d0be7 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:33.719083 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5ee168cb-1547-40c0-b219-b2bd1e2d26c4 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:33.719536 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5ee168cb-1547-40c0-b219-b2bd1e2d26c4 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:33.719773 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b959e798-d433-4521-86bd-039f964d0be7 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:33.720349 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b959e798-d433-4521-86bd-039f964d0be7 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:33.721477 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b959e798-d433-4521-86bd-039f964d0be7 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:33.722178 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b959e798-d433-4521-86bd-039f964d0be7 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:33.722597 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b959e798-d433-4521-86bd-039f964d0be7 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:33.742550 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:33.913050 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-5ee168cb-1547-40c0-b219-b2bd1e2d26c4 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:33.917555 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-b959e798-d433-4521-86bd-039f964d0be7 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:33.923433 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-5ee168cb-1547-40c0-b219-b2bd1e2d26c4 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1568 microversion: 2.1 time: 0.227360 Aug 31 13:05:33.924552 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 271/560] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:33 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1568 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:33.929231 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-58aada93-6b0a-4d5a-ba97-b80391b65498 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:33.929739 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-b959e798-d433-4521-86bd-039f964d0be7 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1678 microversion: 2.1 time: 0.229686 Aug 31 13:05:33.929971 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-58aada93-6b0a-4d5a-ba97-b80391b65498 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:33.931868 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 290/561] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:33 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1678 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:33.939486 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-58aada93-6b0a-4d5a-ba97-b80391b65498 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:33.939486 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-58aada93-6b0a-4d5a-ba97-b80391b65498 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:33.939486 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-58aada93-6b0a-4d5a-ba97-b80391b65498 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:33.939486 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-58aada93-6b0a-4d5a-ba97-b80391b65498 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:33.939931 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-58aada93-6b0a-4d5a-ba97-b80391b65498 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:33.939931 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-58aada93-6b0a-4d5a-ba97-b80391b65498 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:34.068358 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-58aada93-6b0a-4d5a-ba97-b80391b65498 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:34.076651 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-58aada93-6b0a-4d5a-ba97-b80391b65498 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1734 microversion: 2.1 time: 0.150970 Aug 31 13:05:34.077225 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 272/562] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:33 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:34.948779 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-85996ec9-1f8e-4145-9720-89d3cb6f280f tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:34.949756 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-85996ec9-1f8e-4145-9720-89d3cb6f280f tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:34.954722 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-29363227-7aa5-455c-b738-0ddcecb94cf0 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:34.955467 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-29363227-7aa5-455c-b738-0ddcecb94cf0 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:34.959111 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-85996ec9-1f8e-4145-9720-89d3cb6f280f tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:34.959738 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-85996ec9-1f8e-4145-9720-89d3cb6f280f tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:34.960246 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-85996ec9-1f8e-4145-9720-89d3cb6f280f tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:34.960860 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-85996ec9-1f8e-4145-9720-89d3cb6f280f tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:34.961609 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-85996ec9-1f8e-4145-9720-89d3cb6f280f tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:34.961807 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-85996ec9-1f8e-4145-9720-89d3cb6f280f tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:34.962768 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-29363227-7aa5-455c-b738-0ddcecb94cf0 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:34.963316 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-29363227-7aa5-455c-b738-0ddcecb94cf0 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:34.963832 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-29363227-7aa5-455c-b738-0ddcecb94cf0 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:34.964605 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-29363227-7aa5-455c-b738-0ddcecb94cf0 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:34.965052 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-29363227-7aa5-455c-b738-0ddcecb94cf0 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:34.965467 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-29363227-7aa5-455c-b738-0ddcecb94cf0 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:35.159010 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-85996ec9-1f8e-4145-9720-89d3cb6f280f tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:35.166196 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-29363227-7aa5-455c-b738-0ddcecb94cf0 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:35.167102 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-85996ec9-1f8e-4145-9720-89d3cb6f280f tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1568 microversion: 2.1 time: 0.224852 Aug 31 13:05:35.167691 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 291/563] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:34 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:35.172212 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-26bb0295-28a5-433e-af35-bfe9c7ae3d2f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:35.172805 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-26bb0295-28a5-433e-af35-bfe9c7ae3d2f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:35.174575 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-29363227-7aa5-455c-b738-0ddcecb94cf0 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1678 microversion: 2.1 time: 0.226471 Aug 31 13:05:35.175322 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 273/564] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:34 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1678 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:35.178711 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-26bb0295-28a5-433e-af35-bfe9c7ae3d2f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:35.179183 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-26bb0295-28a5-433e-af35-bfe9c7ae3d2f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:35.179610 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-26bb0295-28a5-433e-af35-bfe9c7ae3d2f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:35.180322 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-26bb0295-28a5-433e-af35-bfe9c7ae3d2f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:35.180832 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-26bb0295-28a5-433e-af35-bfe9c7ae3d2f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:35.181252 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-26bb0295-28a5-433e-af35-bfe9c7ae3d2f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:35.320147 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-26bb0295-28a5-433e-af35-bfe9c7ae3d2f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:35.333790 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-26bb0295-28a5-433e-af35-bfe9c7ae3d2f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1734 microversion: 2.1 time: 0.164817 Aug 31 13:05:35.334717 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 292/565] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:35 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:36.191734 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-d023d3c7-c55b-42c0-be7e-d15cbe2c1da9 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:36.192322 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-d023d3c7-c55b-42c0-be7e-d15cbe2c1da9 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:36.196722 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-105b30c7-fbc1-4dc0-bca6-56971ca94c64 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:36.197327 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-105b30c7-fbc1-4dc0-bca6-56971ca94c64 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:36.199389 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d023d3c7-c55b-42c0-be7e-d15cbe2c1da9 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:36.199904 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d023d3c7-c55b-42c0-be7e-d15cbe2c1da9 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:36.200334 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d023d3c7-c55b-42c0-be7e-d15cbe2c1da9 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:36.201008 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d023d3c7-c55b-42c0-be7e-d15cbe2c1da9 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:36.201472 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d023d3c7-c55b-42c0-be7e-d15cbe2c1da9 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:36.201876 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d023d3c7-c55b-42c0-be7e-d15cbe2c1da9 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:36.205234 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-105b30c7-fbc1-4dc0-bca6-56971ca94c64 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:36.205716 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-105b30c7-fbc1-4dc0-bca6-56971ca94c64 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:36.206193 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-105b30c7-fbc1-4dc0-bca6-56971ca94c64 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:36.206892 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-105b30c7-fbc1-4dc0-bca6-56971ca94c64 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:36.207334 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-105b30c7-fbc1-4dc0-bca6-56971ca94c64 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:36.207749 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-105b30c7-fbc1-4dc0-bca6-56971ca94c64 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:36.395844 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-d023d3c7-c55b-42c0-be7e-d15cbe2c1da9 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:36.398965 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-105b30c7-fbc1-4dc0-bca6-56971ca94c64 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:36.404298 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-d023d3c7-c55b-42c0-be7e-d15cbe2c1da9 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1568 microversion: 2.1 time: 0.218614 Aug 31 13:05:36.405018 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 274/566] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:36 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1568 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:36.411186 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-84cb91c9-39a0-4467-9b16-d01ced73141b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:36.411714 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-105b30c7-fbc1-4dc0-bca6-56971ca94c64 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1678 microversion: 2.1 time: 0.218751 Aug 31 13:05:36.411857 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-84cb91c9-39a0-4467-9b16-d01ced73141b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:36.415916 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 293/567] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:36 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1678 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:36.420389 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-84cb91c9-39a0-4467-9b16-d01ced73141b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:36.420979 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-84cb91c9-39a0-4467-9b16-d01ced73141b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:36.421579 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-84cb91c9-39a0-4467-9b16-d01ced73141b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:36.422511 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-84cb91c9-39a0-4467-9b16-d01ced73141b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:36.423155 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-84cb91c9-39a0-4467-9b16-d01ced73141b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:36.423701 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-84cb91c9-39a0-4467-9b16-d01ced73141b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:36.442535 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:36.561268 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-84cb91c9-39a0-4467-9b16-d01ced73141b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:36.570063 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-84cb91c9-39a0-4467-9b16-d01ced73141b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1734 microversion: 2.1 time: 0.163839 Aug 31 13:05:36.570638 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 275/568] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:36 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:37.433326 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-ba86124e-a82b-4410-8a77-a0ea84158a9f tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:37.434316 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-ba86124e-a82b-4410-8a77-a0ea84158a9f tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:37.441190 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-28c817c6-7fbb-4759-8917-9b25bf45a1f6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:37.442162 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-28c817c6-7fbb-4759-8917-9b25bf45a1f6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:37.444878 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ba86124e-a82b-4410-8a77-a0ea84158a9f tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:37.445360 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ba86124e-a82b-4410-8a77-a0ea84158a9f tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:37.445785 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ba86124e-a82b-4410-8a77-a0ea84158a9f tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:37.446447 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ba86124e-a82b-4410-8a77-a0ea84158a9f tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:37.446912 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ba86124e-a82b-4410-8a77-a0ea84158a9f tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:37.447326 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ba86124e-a82b-4410-8a77-a0ea84158a9f tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:37.448310 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-28c817c6-7fbb-4759-8917-9b25bf45a1f6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:37.448862 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-28c817c6-7fbb-4759-8917-9b25bf45a1f6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:37.449428 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-28c817c6-7fbb-4759-8917-9b25bf45a1f6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:37.450106 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-28c817c6-7fbb-4759-8917-9b25bf45a1f6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:37.450550 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-28c817c6-7fbb-4759-8917-9b25bf45a1f6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:37.450966 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-28c817c6-7fbb-4759-8917-9b25bf45a1f6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:37.647153 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-ba86124e-a82b-4410-8a77-a0ea84158a9f tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:37.651226 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-28c817c6-7fbb-4759-8917-9b25bf45a1f6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:37.655368 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-ba86124e-a82b-4410-8a77-a0ea84158a9f tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1568 microversion: 2.1 time: 0.228541 Aug 31 13:05:37.655986 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 294/569] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:37 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:37.659784 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-28c817c6-7fbb-4759-8917-9b25bf45a1f6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1678 microversion: 2.1 time: 0.226102 Aug 31 13:05:37.660881 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-417bfec4-5ef9-4106-824e-3625521b08cc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:37.661538 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-417bfec4-5ef9-4106-824e-3625521b08cc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:37.667003 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 276/570] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:37 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1678 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:37.667565 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-417bfec4-5ef9-4106-824e-3625521b08cc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:37.668074 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-417bfec4-5ef9-4106-824e-3625521b08cc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:37.668503 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-417bfec4-5ef9-4106-824e-3625521b08cc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:37.669190 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-417bfec4-5ef9-4106-824e-3625521b08cc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:37.669633 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-417bfec4-5ef9-4106-824e-3625521b08cc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:37.670045 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-417bfec4-5ef9-4106-824e-3625521b08cc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:37.810323 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-417bfec4-5ef9-4106-824e-3625521b08cc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:37.819164 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-417bfec4-5ef9-4106-824e-3625521b08cc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1734 microversion: 2.1 time: 0.162163 Aug 31 13:05:37.819773 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 295/571] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:37 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:38.678560 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b84eef0d-0187-4a02-beda-0a2ae9845d66 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:38.679162 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b84eef0d-0187-4a02-beda-0a2ae9845d66 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:38.681113 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-94de2940-f935-4fe1-91de-d72b00bbc895 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:38.681712 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-94de2940-f935-4fe1-91de-d72b00bbc895 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:38.686089 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b84eef0d-0187-4a02-beda-0a2ae9845d66 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:38.686579 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b84eef0d-0187-4a02-beda-0a2ae9845d66 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:38.686985 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b84eef0d-0187-4a02-beda-0a2ae9845d66 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:38.687705 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b84eef0d-0187-4a02-beda-0a2ae9845d66 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:38.688196 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b84eef0d-0187-4a02-beda-0a2ae9845d66 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:38.688349 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-94de2940-f935-4fe1-91de-d72b00bbc895 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:38.688610 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b84eef0d-0187-4a02-beda-0a2ae9845d66 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:38.688768 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-94de2940-f935-4fe1-91de-d72b00bbc895 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:38.689124 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-94de2940-f935-4fe1-91de-d72b00bbc895 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:38.689802 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-94de2940-f935-4fe1-91de-d72b00bbc895 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:38.690239 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-94de2940-f935-4fe1-91de-d72b00bbc895 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:38.690651 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-94de2940-f935-4fe1-91de-d72b00bbc895 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:38.891085 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-b84eef0d-0187-4a02-beda-0a2ae9845d66 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:38.894034 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-94de2940-f935-4fe1-91de-d72b00bbc895 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:38.899491 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b84eef0d-0187-4a02-beda-0a2ae9845d66 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1568 microversion: 2.1 time: 0.225635 Aug 31 13:05:38.900148 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 277/572] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:38 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1568 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:38.902146 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-94de2940-f935-4fe1-91de-d72b00bbc895 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1678 microversion: 2.1 time: 0.224687 Aug 31 13:05:38.902930 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 296/573] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:38 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1678 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:38.904609 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-72bd3512-bea1-472c-8485-5a6b66317906 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:38.905208 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-72bd3512-bea1-472c-8485-5a6b66317906 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:38.911442 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-72bd3512-bea1-472c-8485-5a6b66317906 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:38.911938 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-72bd3512-bea1-472c-8485-5a6b66317906 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:38.912373 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-72bd3512-bea1-472c-8485-5a6b66317906 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:38.913067 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-72bd3512-bea1-472c-8485-5a6b66317906 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:38.913516 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-72bd3512-bea1-472c-8485-5a6b66317906 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:38.913937 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-72bd3512-bea1-472c-8485-5a6b66317906 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:39.044603 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-72bd3512-bea1-472c-8485-5a6b66317906 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:39.057294 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-72bd3512-bea1-472c-8485-5a6b66317906 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1734 microversion: 2.1 time: 0.155877 Aug 31 13:05:39.058066 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 278/574] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:38 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:39.921922 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-3fc49b66-b2e4-47b9-9665-77be1f609669 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:39.922608 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-3fc49b66-b2e4-47b9-9665-77be1f609669 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:39.924418 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-421da08e-26ff-4f6a-a5a1-b3ed89c2a1eb tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:39.925109 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-421da08e-26ff-4f6a-a5a1-b3ed89c2a1eb tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:39.929429 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3fc49b66-b2e4-47b9-9665-77be1f609669 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:39.929910 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3fc49b66-b2e4-47b9-9665-77be1f609669 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:39.930339 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3fc49b66-b2e4-47b9-9665-77be1f609669 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:39.931073 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3fc49b66-b2e4-47b9-9665-77be1f609669 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:39.931556 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3fc49b66-b2e4-47b9-9665-77be1f609669 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:39.931806 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-421da08e-26ff-4f6a-a5a1-b3ed89c2a1eb tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:39.932036 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3fc49b66-b2e4-47b9-9665-77be1f609669 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:39.932349 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-421da08e-26ff-4f6a-a5a1-b3ed89c2a1eb tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:39.932777 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-421da08e-26ff-4f6a-a5a1-b3ed89c2a1eb tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:39.933458 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-421da08e-26ff-4f6a-a5a1-b3ed89c2a1eb tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:39.933900 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-421da08e-26ff-4f6a-a5a1-b3ed89c2a1eb tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:39.934470 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-421da08e-26ff-4f6a-a5a1-b3ed89c2a1eb tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:40.129958 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-421da08e-26ff-4f6a-a5a1-b3ed89c2a1eb tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:40.134738 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-3fc49b66-b2e4-47b9-9665-77be1f609669 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:40.139458 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-421da08e-26ff-4f6a-a5a1-b3ed89c2a1eb tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1678 microversion: 2.1 time: 0.219050 Aug 31 13:05:40.140050 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 279/575] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:39 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1678 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:40.143054 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-3fc49b66-b2e4-47b9-9665-77be1f609669 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1568 microversion: 2.1 time: 0.225063 Aug 31 13:05:40.143631 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 297/576] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:39 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:40.144452 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-4b823384-615d-4347-8445-13a903910215 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:40.145309 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-4b823384-615d-4347-8445-13a903910215 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:40.151139 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4b823384-615d-4347-8445-13a903910215 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:40.151578 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4b823384-615d-4347-8445-13a903910215 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:40.152263 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4b823384-615d-4347-8445-13a903910215 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:40.152946 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4b823384-615d-4347-8445-13a903910215 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:40.153396 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4b823384-615d-4347-8445-13a903910215 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:40.153806 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4b823384-615d-4347-8445-13a903910215 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:40.333165 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-4b823384-615d-4347-8445-13a903910215 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:40.341952 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-4b823384-615d-4347-8445-13a903910215 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1734 microversion: 2.1 time: 0.200953 Aug 31 13:05:40.342558 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 280/577] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:40 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1734 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:41.164413 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-c15953a9-e530-4f4d-b335-3044f137463d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:41.165002 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-c15953a9-e530-4f4d-b335-3044f137463d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:41.166314 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-13271f58-9d98-4a51-850a-ed200e9fa9de tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:41.167058 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-13271f58-9d98-4a51-850a-ed200e9fa9de tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:41.172935 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c15953a9-e530-4f4d-b335-3044f137463d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:41.173696 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c15953a9-e530-4f4d-b335-3044f137463d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:41.174216 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c15953a9-e530-4f4d-b335-3044f137463d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:41.174379 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-13271f58-9d98-4a51-850a-ed200e9fa9de tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:41.174936 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-13271f58-9d98-4a51-850a-ed200e9fa9de tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:41.175113 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c15953a9-e530-4f4d-b335-3044f137463d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:41.175440 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-13271f58-9d98-4a51-850a-ed200e9fa9de tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:41.175710 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c15953a9-e530-4f4d-b335-3044f137463d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:41.176055 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c15953a9-e530-4f4d-b335-3044f137463d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:41.176346 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-13271f58-9d98-4a51-850a-ed200e9fa9de tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:41.176876 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-13271f58-9d98-4a51-850a-ed200e9fa9de tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:41.177375 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-13271f58-9d98-4a51-850a-ed200e9fa9de tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:41.372557 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-c15953a9-e530-4f4d-b335-3044f137463d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:41.377465 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-13271f58-9d98-4a51-850a-ed200e9fa9de tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:41.380777 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-c15953a9-e530-4f4d-b335-3044f137463d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1678 microversion: 2.1 time: 0.221656 Aug 31 13:05:41.381367 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 298/578] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:41 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1678 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:41.385831 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-6ae93ef5-fa99-4996-b1b3-8985dd6ce6ac tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:41.386385 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-13271f58-9d98-4a51-850a-ed200e9fa9de tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1568 microversion: 2.1 time: 0.224490 Aug 31 13:05:41.386514 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-6ae93ef5-fa99-4996-b1b3-8985dd6ce6ac tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:41.391341 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 281/579] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:41 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:41.392797 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6ae93ef5-fa99-4996-b1b3-8985dd6ce6ac tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:41.393408 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6ae93ef5-fa99-4996-b1b3-8985dd6ce6ac tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:41.393811 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6ae93ef5-fa99-4996-b1b3-8985dd6ce6ac tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:41.395127 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6ae93ef5-fa99-4996-b1b3-8985dd6ce6ac tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:41.395573 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6ae93ef5-fa99-4996-b1b3-8985dd6ce6ac tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:41.396013 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6ae93ef5-fa99-4996-b1b3-8985dd6ce6ac tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:41.543243 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-6ae93ef5-fa99-4996-b1b3-8985dd6ce6ac tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:41.554443 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-6ae93ef5-fa99-4996-b1b3-8985dd6ce6ac tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1734 microversion: 2.1 time: 0.172150 Aug 31 13:05:41.555053 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 299/580] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:41 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:42.403690 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-2a968411-9136-4740-b105-0173cc2bb599 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:42.404466 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-2a968411-9136-4740-b105-0173cc2bb599 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:42.409372 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-e829991a-b1e7-4960-84b8-7252c1b39689 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:42.410178 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-e829991a-b1e7-4960-84b8-7252c1b39689 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:42.413971 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2a968411-9136-4740-b105-0173cc2bb599 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:42.414652 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2a968411-9136-4740-b105-0173cc2bb599 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:42.415522 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2a968411-9136-4740-b105-0173cc2bb599 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:42.416713 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2a968411-9136-4740-b105-0173cc2bb599 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:42.417340 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2a968411-9136-4740-b105-0173cc2bb599 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:42.417990 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2a968411-9136-4740-b105-0173cc2bb599 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:42.419370 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e829991a-b1e7-4960-84b8-7252c1b39689 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:42.420147 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e829991a-b1e7-4960-84b8-7252c1b39689 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:42.420830 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e829991a-b1e7-4960-84b8-7252c1b39689 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:42.421865 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e829991a-b1e7-4960-84b8-7252c1b39689 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:42.422547 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e829991a-b1e7-4960-84b8-7252c1b39689 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:42.423212 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e829991a-b1e7-4960-84b8-7252c1b39689 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:42.613151 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-2a968411-9136-4740-b105-0173cc2bb599 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:42.617306 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-e829991a-b1e7-4960-84b8-7252c1b39689 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:42.624904 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-2a968411-9136-4740-b105-0173cc2bb599 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1678 microversion: 2.1 time: 0.226163 Aug 31 13:05:42.625719 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 282/581] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:42 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1678 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:42.625919 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-e829991a-b1e7-4960-84b8-7252c1b39689 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1568 microversion: 2.1 time: 0.221597 Aug 31 13:05:42.626719 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 300/582] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:42 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1568 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:42.630305 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-44c3b035-62ff-479a-b281-93a242d7fc0d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:42.630872 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-44c3b035-62ff-479a-b281-93a242d7fc0d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:42.637405 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-44c3b035-62ff-479a-b281-93a242d7fc0d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:42.637987 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-44c3b035-62ff-479a-b281-93a242d7fc0d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:42.638422 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-44c3b035-62ff-479a-b281-93a242d7fc0d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:42.639132 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-44c3b035-62ff-479a-b281-93a242d7fc0d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:42.639577 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-44c3b035-62ff-479a-b281-93a242d7fc0d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:42.640022 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-44c3b035-62ff-479a-b281-93a242d7fc0d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:42.770770 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-44c3b035-62ff-479a-b281-93a242d7fc0d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:42.779600 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-44c3b035-62ff-479a-b281-93a242d7fc0d tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1734 microversion: 2.1 time: 0.153024 Aug 31 13:05:42.780199 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 283/583] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:42 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:43.648568 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-f87b7e27-058f-46a0-9647-3d928c5caa86 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:43.649171 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-f87b7e27-058f-46a0-9647-3d928c5caa86 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:43.651085 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-81d9fc21-063f-4d3d-98ca-db06dd9ed5dc tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:43.651759 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-81d9fc21-063f-4d3d-98ca-db06dd9ed5dc tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:43.657015 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f87b7e27-058f-46a0-9647-3d928c5caa86 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:43.657529 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f87b7e27-058f-46a0-9647-3d928c5caa86 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:43.658021 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f87b7e27-058f-46a0-9647-3d928c5caa86 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:43.659101 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f87b7e27-058f-46a0-9647-3d928c5caa86 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:43.659429 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-81d9fc21-063f-4d3d-98ca-db06dd9ed5dc tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:43.659601 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f87b7e27-058f-46a0-9647-3d928c5caa86 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:43.659976 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-81d9fc21-063f-4d3d-98ca-db06dd9ed5dc tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:43.660125 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f87b7e27-058f-46a0-9647-3d928c5caa86 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:43.660540 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-81d9fc21-063f-4d3d-98ca-db06dd9ed5dc tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:43.661225 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-81d9fc21-063f-4d3d-98ca-db06dd9ed5dc tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:43.661665 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-81d9fc21-063f-4d3d-98ca-db06dd9ed5dc tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:43.662116 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-81d9fc21-063f-4d3d-98ca-db06dd9ed5dc tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:43.853787 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-f87b7e27-058f-46a0-9647-3d928c5caa86 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:43.857422 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-81d9fc21-063f-4d3d-98ca-db06dd9ed5dc tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:43.861753 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-f87b7e27-058f-46a0-9647-3d928c5caa86 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1678 microversion: 2.1 time: 0.217847 Aug 31 13:05:43.862331 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 301/584] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:43 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1678 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:43.865536 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-81d9fc21-063f-4d3d-98ca-db06dd9ed5dc tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1568 microversion: 2.1 time: 0.218705 Aug 31 13:05:43.866307 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 284/585] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:43 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1568 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:43.867143 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-56de58fd-2e91-4a79-a1ef-b0a05efccced tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:43.867750 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-56de58fd-2e91-4a79-a1ef-b0a05efccced tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:43.873737 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-56de58fd-2e91-4a79-a1ef-b0a05efccced tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:43.874214 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-56de58fd-2e91-4a79-a1ef-b0a05efccced tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:43.874638 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-56de58fd-2e91-4a79-a1ef-b0a05efccced tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:43.875318 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-56de58fd-2e91-4a79-a1ef-b0a05efccced tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:43.875851 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-56de58fd-2e91-4a79-a1ef-b0a05efccced tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:43.876287 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-56de58fd-2e91-4a79-a1ef-b0a05efccced tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:44.005470 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-56de58fd-2e91-4a79-a1ef-b0a05efccced tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:44.014346 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-56de58fd-2e91-4a79-a1ef-b0a05efccced tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1734 microversion: 2.1 time: 0.151046 Aug 31 13:05:44.014898 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 302/586] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:43 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:44.885730 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-7eda79fd-8c7b-41fb-b01f-e2fc3f5a4b24 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:44.886487 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-7eda79fd-8c7b-41fb-b01f-e2fc3f5a4b24 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:44.888131 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-37ee6dc1-913b-4d22-a8a9-66474484baf8 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:44.888980 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-37ee6dc1-913b-4d22-a8a9-66474484baf8 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:44.894833 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7eda79fd-8c7b-41fb-b01f-e2fc3f5a4b24 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:44.895433 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7eda79fd-8c7b-41fb-b01f-e2fc3f5a4b24 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:44.896009 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7eda79fd-8c7b-41fb-b01f-e2fc3f5a4b24 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:44.896873 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7eda79fd-8c7b-41fb-b01f-e2fc3f5a4b24 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:44.897179 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-37ee6dc1-913b-4d22-a8a9-66474484baf8 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:44.897434 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7eda79fd-8c7b-41fb-b01f-e2fc3f5a4b24 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:44.897782 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-37ee6dc1-913b-4d22-a8a9-66474484baf8 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:44.897929 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7eda79fd-8c7b-41fb-b01f-e2fc3f5a4b24 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:44.898348 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-37ee6dc1-913b-4d22-a8a9-66474484baf8 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:44.899208 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-37ee6dc1-913b-4d22-a8a9-66474484baf8 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:44.899769 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-37ee6dc1-913b-4d22-a8a9-66474484baf8 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:44.900348 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-37ee6dc1-913b-4d22-a8a9-66474484baf8 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:45.093889 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-7eda79fd-8c7b-41fb-b01f-e2fc3f5a4b24 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:45.098624 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-37ee6dc1-913b-4d22-a8a9-66474484baf8 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:45.102957 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-7eda79fd-8c7b-41fb-b01f-e2fc3f5a4b24 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1678 microversion: 2.1 time: 0.222227 Aug 31 13:05:45.103542 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 285/587] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:44 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1678 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:45.106489 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-37ee6dc1-913b-4d22-a8a9-66474484baf8 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1568 microversion: 2.1 time: 0.223299 Aug 31 13:05:45.107041 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 303/588] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:44 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1568 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:45.108031 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-c37c5edb-e211-43ed-9cdd-bf6995f68589 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:45.108843 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-c37c5edb-e211-43ed-9cdd-bf6995f68589 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:45.114854 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c37c5edb-e211-43ed-9cdd-bf6995f68589 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:45.115364 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c37c5edb-e211-43ed-9cdd-bf6995f68589 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:45.115796 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c37c5edb-e211-43ed-9cdd-bf6995f68589 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:45.116601 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c37c5edb-e211-43ed-9cdd-bf6995f68589 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:45.117060 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c37c5edb-e211-43ed-9cdd-bf6995f68589 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:45.117482 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c37c5edb-e211-43ed-9cdd-bf6995f68589 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:45.253248 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-c37c5edb-e211-43ed-9cdd-bf6995f68589 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:45.265599 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-c37c5edb-e211-43ed-9cdd-bf6995f68589 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1734 microversion: 2.1 time: 0.160648 Aug 31 13:05:45.266240 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 286/589] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:45 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:46.128336 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-3e9772fb-151e-4957-be89-bddb30ae5129 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:46.129404 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-3e9772fb-151e-4957-be89-bddb30ae5129 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:46.131278 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-81eed484-997d-4c6a-868c-d7eaaa89c4f0 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:46.132320 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-81eed484-997d-4c6a-868c-d7eaaa89c4f0 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:46.140339 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3e9772fb-151e-4957-be89-bddb30ae5129 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:46.141151 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3e9772fb-151e-4957-be89-bddb30ae5129 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:46.141917 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3e9772fb-151e-4957-be89-bddb30ae5129 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:46.143056 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3e9772fb-151e-4957-be89-bddb30ae5129 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:46.143305 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-81eed484-997d-4c6a-868c-d7eaaa89c4f0 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:46.143806 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3e9772fb-151e-4957-be89-bddb30ae5129 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:46.144108 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-81eed484-997d-4c6a-868c-d7eaaa89c4f0 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:46.144556 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3e9772fb-151e-4957-be89-bddb30ae5129 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:46.144895 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-81eed484-997d-4c6a-868c-d7eaaa89c4f0 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:46.145436 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-81eed484-997d-4c6a-868c-d7eaaa89c4f0 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:46.145887 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-81eed484-997d-4c6a-868c-d7eaaa89c4f0 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:46.146302 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-81eed484-997d-4c6a-868c-d7eaaa89c4f0 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:46.351309 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-3e9772fb-151e-4957-be89-bddb30ae5129 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:46.356023 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-81eed484-997d-4c6a-868c-d7eaaa89c4f0 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:46.362486 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-3e9772fb-151e-4957-be89-bddb30ae5129 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1678 microversion: 2.1 time: 0.240443 Aug 31 13:05:46.363192 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 304/590] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:46 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1678 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:46.366327 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-81eed484-997d-4c6a-868c-d7eaaa89c4f0 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1568 microversion: 2.1 time: 0.241340 Aug 31 13:05:46.366985 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 287/591] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:46 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1568 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:46.367912 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-4f544a6e-bbcf-4e4f-bad0-3c1733b5da22 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:46.368928 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-4f544a6e-bbcf-4e4f-bad0-3c1733b5da22 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:46.375219 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4f544a6e-bbcf-4e4f-bad0-3c1733b5da22 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:46.375784 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4f544a6e-bbcf-4e4f-bad0-3c1733b5da22 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:46.376312 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4f544a6e-bbcf-4e4f-bad0-3c1733b5da22 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:46.376980 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4f544a6e-bbcf-4e4f-bad0-3c1733b5da22 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:46.377417 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4f544a6e-bbcf-4e4f-bad0-3c1733b5da22 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:46.377831 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4f544a6e-bbcf-4e4f-bad0-3c1733b5da22 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:46.515147 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-4f544a6e-bbcf-4e4f-bad0-3c1733b5da22 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:46.525424 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-4f544a6e-bbcf-4e4f-bad0-3c1733b5da22 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1734 microversion: 2.1 time: 0.160854 Aug 31 13:05:46.526355 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 305/592] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:46 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:47.388174 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-72b58a57-fd4b-4547-ad80-8c9e29839be0 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:47.389205 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-72b58a57-fd4b-4547-ad80-8c9e29839be0 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:47.390658 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-9f751a08-a2a8-47f9-a1ca-040b7443036b tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:47.392680 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-9f751a08-a2a8-47f9-a1ca-040b7443036b tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:47.399525 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-72b58a57-fd4b-4547-ad80-8c9e29839be0 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:47.400382 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-72b58a57-fd4b-4547-ad80-8c9e29839be0 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:47.401107 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-72b58a57-fd4b-4547-ad80-8c9e29839be0 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:47.402240 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-72b58a57-fd4b-4547-ad80-8c9e29839be0 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:47.402990 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-72b58a57-fd4b-4547-ad80-8c9e29839be0 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:47.403481 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9f751a08-a2a8-47f9-a1ca-040b7443036b tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:47.403734 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-72b58a57-fd4b-4547-ad80-8c9e29839be0 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:47.404344 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9f751a08-a2a8-47f9-a1ca-040b7443036b tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:47.405053 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9f751a08-a2a8-47f9-a1ca-040b7443036b tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:47.406181 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9f751a08-a2a8-47f9-a1ca-040b7443036b tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:47.406924 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9f751a08-a2a8-47f9-a1ca-040b7443036b tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:47.407617 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9f751a08-a2a8-47f9-a1ca-040b7443036b tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:47.597825 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-9f751a08-a2a8-47f9-a1ca-040b7443036b tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:47.604998 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-72b58a57-fd4b-4547-ad80-8c9e29839be0 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:47.606192 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-9f751a08-a2a8-47f9-a1ca-040b7443036b tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1569 microversion: 2.1 time: 0.222017 Aug 31 13:05:47.608432 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 306/593] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:47 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1569 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:47.611108 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-827adb71-fcc2-427a-ae23-c57789a710ae tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:47.612039 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-827adb71-fcc2-427a-ae23-c57789a710ae tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:47.614188 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_api:SELECT=57 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:47.614366 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-72b58a57-fd4b-4547-ad80-8c9e29839be0 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1678 microversion: 2.1 time: 0.232373 Aug 31 13:05:47.615478 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 288/594] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:47 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1678 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:47.627030 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-827adb71-fcc2-427a-ae23-c57789a710ae tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:47.628343 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-9b644e0f-545d-494c-a337-62ee79a93576 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:05:47.628933 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-9b644e0f-545d-494c-a337-62ee79a93576 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:47.630912 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-827adb71-fcc2-427a-ae23-c57789a710ae tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:47.631341 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-827adb71-fcc2-427a-ae23-c57789a710ae tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:47.632065 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-827adb71-fcc2-427a-ae23-c57789a710ae tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:47.632512 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-827adb71-fcc2-427a-ae23-c57789a710ae tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:47.632926 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-827adb71-fcc2-427a-ae23-c57789a710ae tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:47.637252 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell1:SELECT=100 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:47.641699 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9b644e0f-545d-494c-a337-62ee79a93576 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:47.642115 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9b644e0f-545d-494c-a337-62ee79a93576 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:47.642531 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9b644e0f-545d-494c-a337-62ee79a93576 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:47.643224 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9b644e0f-545d-494c-a337-62ee79a93576 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:47.643667 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9b644e0f-545d-494c-a337-62ee79a93576 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:47.644118 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9b644e0f-545d-494c-a337-62ee79a93576 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:47.778120 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-827adb71-fcc2-427a-ae23-c57789a710ae tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:47.787415 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-827adb71-fcc2-427a-ae23-c57789a710ae tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1734 microversion: 2.1 time: 0.179640 Aug 31 13:05:47.788115 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 307/595] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:47 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1734 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:47.796270 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-9b644e0f-545d-494c-a337-62ee79a93576 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120705) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 13:05:47.871611 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-9b644e0f-545d-494c-a337-62ee79a93576 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "POST /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a/action" status: 202 len: 0 microversion: 2.1 time: 0.248876 Aug 31 13:05:47.872748 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 289/596] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 31 13:05:47 2022] POST /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 13:05:47.881521 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-51b17749-efa9-4fc3-b80f-7a4ce383a8eb tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:47.882153 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-51b17749-efa9-4fc3-b80f-7a4ce383a8eb tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:47.885935 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-f54c76ba-74e8-4c99-8f31-da6273737544 req-831058fe-3095-45fd-aef6-695a8f892161 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e792077-8a21-48f8-8f65-ce1a4aae8c0a", "name": "network-vif-unplugged", "status": "completed", "tag": "22506bf3-0225-4ad3-b8d6-55645f334201"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:05:47.888803 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-51b17749-efa9-4fc3-b80f-7a4ce383a8eb tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:47.889195 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-51b17749-efa9-4fc3-b80f-7a4ce383a8eb tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:47.889629 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-51b17749-efa9-4fc3-b80f-7a4ce383a8eb tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:47.890329 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-51b17749-efa9-4fc3-b80f-7a4ce383a8eb tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:47.890773 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-51b17749-efa9-4fc3-b80f-7a4ce383a8eb tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:47.891388 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-51b17749-efa9-4fc3-b80f-7a4ce383a8eb tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:47.898431 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-f54c76ba-74e8-4c99-8f31-da6273737544 req-831058fe-3095-45fd-aef6-695a8f892161 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:47.899148 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-f54c76ba-74e8-4c99-8f31-da6273737544 req-831058fe-3095-45fd-aef6-695a8f892161 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:47.900332 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-f54c76ba-74e8-4c99-8f31-da6273737544 req-831058fe-3095-45fd-aef6-695a8f892161 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:47.916823 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-f54c76ba-74e8-4c99-8f31-da6273737544 req-831058fe-3095-45fd-aef6-695a8f892161 service nova] Creating event network-vif-unplugged:22506bf3-0225-4ad3-b8d6-55645f334201 for instance 9e792077-8a21-48f8-8f65-ce1a4aae8c0a on hv-cinder-85442 Aug 31 13:05:47.927974 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-f54c76ba-74e8-4c99-8f31-da6273737544 req-831058fe-3095-45fd-aef6-695a8f892161 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103018 Aug 31 13:05:47.928830 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 308/597] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:05:48.074565 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-51b17749-efa9-4fc3-b80f-7a4ce383a8eb tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:48.084718 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-51b17749-efa9-4fc3-b80f-7a4ce383a8eb tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1577 microversion: 2.1 time: 0.208091 Aug 31 13:05:48.085299 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 290/598] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:47 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1577 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:05:48.642133 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-339ec89c-9c43-4fe9-801e-0247c5d543f9 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:48.643329 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-339ec89c-9c43-4fe9-801e-0247c5d543f9 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:48.654451 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-339ec89c-9c43-4fe9-801e-0247c5d543f9 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:48.655238 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-339ec89c-9c43-4fe9-801e-0247c5d543f9 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:48.656152 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-339ec89c-9c43-4fe9-801e-0247c5d543f9 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:48.658006 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-339ec89c-9c43-4fe9-801e-0247c5d543f9 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:48.659362 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-339ec89c-9c43-4fe9-801e-0247c5d543f9 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:48.660138 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-339ec89c-9c43-4fe9-801e-0247c5d543f9 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:48.795357 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-339ec89c-9c43-4fe9-801e-0247c5d543f9 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:48.803733 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-339ec89c-9c43-4fe9-801e-0247c5d543f9 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1678 microversion: 2.1 time: 0.168708 Aug 31 13:05:48.804334 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 309/599] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:48 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:48.809343 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-6b171f1c-93f7-4ffd-98a7-b4901621223f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:48.809916 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-6b171f1c-93f7-4ffd-98a7-b4901621223f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:48.817464 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6b171f1c-93f7-4ffd-98a7-b4901621223f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:48.819164 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6b171f1c-93f7-4ffd-98a7-b4901621223f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:48.819164 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6b171f1c-93f7-4ffd-98a7-b4901621223f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:48.819164 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6b171f1c-93f7-4ffd-98a7-b4901621223f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:48.819569 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6b171f1c-93f7-4ffd-98a7-b4901621223f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:48.820071 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6b171f1c-93f7-4ffd-98a7-b4901621223f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:48.824417 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:48.962246 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-6b171f1c-93f7-4ffd-98a7-b4901621223f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:48.974014 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-6b171f1c-93f7-4ffd-98a7-b4901621223f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1734 microversion: 2.1 time: 0.168598 Aug 31 13:05:48.974517 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 291/600] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:48 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:49.113847 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-4c2ffa20-b943-4e02-b2c1-01858a42a213 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:49.114490 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-4c2ffa20-b943-4e02-b2c1-01858a42a213 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:49.121226 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4c2ffa20-b943-4e02-b2c1-01858a42a213 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:49.121731 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4c2ffa20-b943-4e02-b2c1-01858a42a213 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:49.122183 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4c2ffa20-b943-4e02-b2c1-01858a42a213 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:49.122905 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4c2ffa20-b943-4e02-b2c1-01858a42a213 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:49.123410 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4c2ffa20-b943-4e02-b2c1-01858a42a213 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:49.123858 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4c2ffa20-b943-4e02-b2c1-01858a42a213 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:49.270802 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-4c2ffa20-b943-4e02-b2c1-01858a42a213 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:49.278879 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-4c2ffa20-b943-4e02-b2c1-01858a42a213 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1517 microversion: 2.1 time: 0.171675 Aug 31 13:05:49.279460 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 310/601] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:49 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1517 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:49.828626 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-a4330c81-1908-406f-af72-288c00ca307b tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:49.829293 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-a4330c81-1908-406f-af72-288c00ca307b tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:49.837136 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a4330c81-1908-406f-af72-288c00ca307b tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:49.837601 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a4330c81-1908-406f-af72-288c00ca307b tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:49.838065 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a4330c81-1908-406f-af72-288c00ca307b tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:49.838746 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a4330c81-1908-406f-af72-288c00ca307b tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:49.839192 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a4330c81-1908-406f-af72-288c00ca307b tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:49.839606 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a4330c81-1908-406f-af72-288c00ca307b tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:49.980786 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-a4330c81-1908-406f-af72-288c00ca307b tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:49.988815 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-a4330c81-1908-406f-af72-288c00ca307b tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1655 microversion: 2.1 time: 0.166431 Aug 31 13:05:49.989452 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 292/602] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:49 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1655 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:49.994480 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-ae7be505-4a34-4c84-8775-1500abfb6e67 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:49.995089 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-ae7be505-4a34-4c84-8775-1500abfb6e67 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:50.001643 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ae7be505-4a34-4c84-8775-1500abfb6e67 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:50.002126 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ae7be505-4a34-4c84-8775-1500abfb6e67 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:50.002554 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ae7be505-4a34-4c84-8775-1500abfb6e67 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:50.003240 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ae7be505-4a34-4c84-8775-1500abfb6e67 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:50.003689 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ae7be505-4a34-4c84-8775-1500abfb6e67 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:50.004145 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ae7be505-4a34-4c84-8775-1500abfb6e67 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:50.009294 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-7a503288-518c-43af-b116-d672026c6267 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:05:50.015244 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7a503288-518c-43af-b116-d672026c6267 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:50.015719 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7a503288-518c-43af-b116-d672026c6267 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:50.016192 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7a503288-518c-43af-b116-d672026c6267 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:50.039184 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-7a503288-518c-43af-b116-d672026c6267 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Going to try to start instance {{(pid=120705) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 13:05:50.086649 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-7a503288-518c-43af-b116-d672026c6267 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "POST /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf/action" status: 202 len: 0 microversion: 2.1 time: 0.080957 Aug 31 13:05:50.087637 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 293/603] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 31 13:05:50 2022] POST /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:05:50.096433 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b28cf3c6-4daf-4bbc-be4d-e79fefeda885 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:50.097099 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b28cf3c6-4daf-4bbc-be4d-e79fefeda885 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:50.103626 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b28cf3c6-4daf-4bbc-be4d-e79fefeda885 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:50.104284 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b28cf3c6-4daf-4bbc-be4d-e79fefeda885 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:50.104924 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b28cf3c6-4daf-4bbc-be4d-e79fefeda885 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:50.105670 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b28cf3c6-4daf-4bbc-be4d-e79fefeda885 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:50.106215 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b28cf3c6-4daf-4bbc-be4d-e79fefeda885 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:50.106751 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b28cf3c6-4daf-4bbc-be4d-e79fefeda885 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:50.142947 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-ae7be505-4a34-4c84-8775-1500abfb6e67 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:50.151918 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-ae7be505-4a34-4c84-8775-1500abfb6e67 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1714 microversion: 2.1 time: 0.161258 Aug 31 13:05:50.153202 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 311/604] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:49 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1714 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:50.249566 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-b28cf3c6-4daf-4bbc-be4d-e79fefeda885 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:50.258555 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b28cf3c6-4daf-4bbc-be4d-e79fefeda885 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1664 microversion: 2.1 time: 0.166333 Aug 31 13:05:50.259216 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 294/605] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:50 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1664 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:50.266715 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-0acfa5f5-fe55-443d-964b-97016bc63d5c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:50.267344 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-0acfa5f5-fe55-443d-964b-97016bc63d5c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:50.274302 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0acfa5f5-fe55-443d-964b-97016bc63d5c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:50.274761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0acfa5f5-fe55-443d-964b-97016bc63d5c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:50.275191 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0acfa5f5-fe55-443d-964b-97016bc63d5c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:50.275929 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0acfa5f5-fe55-443d-964b-97016bc63d5c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:50.276376 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0acfa5f5-fe55-443d-964b-97016bc63d5c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:50.276795 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0acfa5f5-fe55-443d-964b-97016bc63d5c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:50.300357 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-fbcb5f3b-7c4c-46a5-9cf6-f036433b41a4 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:50.300945 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-fbcb5f3b-7c4c-46a5-9cf6-f036433b41a4 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:50.310762 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fbcb5f3b-7c4c-46a5-9cf6-f036433b41a4 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:50.311702 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fbcb5f3b-7c4c-46a5-9cf6-f036433b41a4 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:50.312606 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fbcb5f3b-7c4c-46a5-9cf6-f036433b41a4 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:50.313422 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fbcb5f3b-7c4c-46a5-9cf6-f036433b41a4 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:50.313932 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fbcb5f3b-7c4c-46a5-9cf6-f036433b41a4 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:50.314358 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fbcb5f3b-7c4c-46a5-9cf6-f036433b41a4 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:50.371805 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.wsgi [None req-0acfa5f5-fe55-443d-964b-97016bc63d5c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] HTTP exception thrown: Cannot 'detach_volume' instance dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec while it is in vm_state rescued Aug 31 13:05:50.373474 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-0acfa5f5-fe55-443d-964b-97016bc63d5c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Request method failure captured: Aug 31 13:05:50.373474 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: request: DELETE /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec/os-volume_attachments/b06416ea-a4ec-4677-a342-64ed4bd5df00 HTTP/1.1 Aug 31 13:05:50.373474 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept: application/json Aug 31 13:05:50.373474 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept-Encoding: identity Aug 31 13:05:50.373474 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Connection: close Aug 31 13:05:50.373474 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Length: 0 Aug 31 13:05:50.373474 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Type: application/json Aug 31 13:05:50.373474 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Host: 10.222.0.58 Aug 31 13:05:50.373474 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Openstack-System-Scope: None Aug 31 13:05:50.373474 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: User-Agent: python-urllib3/1.26.12 Aug 31 13:05:50.373474 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Auth-Token: gAAAAABjD1sZ8K-CuXjoyInmbyCWcKQ2hvstKdaDVHuGOcX86HAp1ceK2FrO69nhO1vsmo_DJ17VxZ7XFBhtbbOOVHhczRe79dWAWnBV79vGZeTskL4gRVzpkATTbtMz8tRcPwNEiHgyNNxRUIMKgIXrh9QhenjZON35FkHfV2_WQxqR1mNYfOg Aug 31 13:05:50.373474 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Id: None Aug 31 13:05:50.373474 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Name: None Aug 31 13:05:50.373474 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Identity-Status: Confirmed Aug 31 13:05:50.373474 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Is-Admin-Project: True Aug 31 13:05:50.373474 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Id: default Aug 31 13:05:50.373474 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Name: Default Aug 31 13:05:50.373474 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Id: b5b2950890c04cff868553069d6aba9a Aug 31 13:05:50.373474 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1816283264 Aug 31 13:05:50.373474 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Role: member,reader Aug 31 13:05:50.373474 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Roles: member,reader Aug 31 13:05:50.375162 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b5b2950890c04cff868553069d6aba9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b5b2950890c04cff868553069d6aba9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b5b2950890c04cff868553069d6aba9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b5b2950890c04cff868553069d6aba9a"}]}] Aug 31 13:05:50.375162 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1816283264 Aug 31 13:05:50.375162 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Id: b5b2950890c04cff868553069d6aba9a Aug 31 13:05:50.375162 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1816283264 Aug 31 13:05:50.375162 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User: tempest-ServerRescueNegativeTestJSON-1816283264-project Aug 31 13:05:50.375162 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Id: default Aug 31 13:05:50.375162 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Name: Default Aug 31 13:05:50.375162 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Id: 32770594db4f437a958fd8c2c145a865 Aug 31 13:05:50.375162 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1816283264-project Aug 31 13:05:50.375162 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: method: > Aug 31 13:05:50.375162 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: exception: Cannot 'detach_volume' instance dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec while it is in vm_state rescued Aug 31 13:05:50.376040 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: action_args: {'server_id': 'dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec', 'id': 'b06416ea-a4ec-4677-a342-64ed4bd5df00'} Aug 31 13:05:50.376040 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:05:50.376040 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:05:50.376040 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 31 13:05:50.376040 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 31 13:05:50.376040 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 13:05:50.376040 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 13:05:50.376040 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 13:05:50.376040 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 13:05:50.376040 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 31 13:05:50.376040 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:05:50.376040 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:05:50.376040 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:05:50.376040 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:05:50.376040 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:05:50.376040 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:05:50.376040 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:05:50.376040 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:05:50.376040 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:05:50.376040 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:05:50.377793 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 31 13:05:50.377793 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 13:05:50.377793 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 13:05:50.377793 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 13:05:50.377793 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec while it is in vm_state rescued Aug 31 13:05:50.377793 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:05:50.377793 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:05:50.377793 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:05:50.377793 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:05:50.377793 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:05:50.377793 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:05:50.377793 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:05:50.377793 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:05:50.377793 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec while it is in vm_state rescued Aug 31 13:05:50.377793 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:05:50.380023 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-0acfa5f5-fe55-443d-964b-97016bc63d5c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Returning 409 to user: Cannot 'detach_volume' instance dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec while it is in vm_state rescued {{(pid=120704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:05:50.380942 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-0acfa5f5-fe55-443d-964b-97016bc63d5c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "DELETE /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec/os-volume_attachments/b06416ea-a4ec-4677-a342-64ed4bd5df00" status: 409 len: 152 microversion: 2.1 time: 0.118437 Aug 31 13:05:50.381526 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 312/606] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 31 13:05:50 2022] DELETE /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec/os-volume_attachments/b06416ea-a4ec-4677-a342-64ed4bd5df00 => generated 152 bytes in 120 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 31 13:05:50.390918 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-68822c6e-3600-4c3e-b7d3-f15eba43804b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:05:50.391442 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-68822c6e-3600-4c3e-b7d3-f15eba43804b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:50.397573 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-68822c6e-3600-4c3e-b7d3-f15eba43804b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:50.398054 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-68822c6e-3600-4c3e-b7d3-f15eba43804b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:50.398477 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-68822c6e-3600-4c3e-b7d3-f15eba43804b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:50.399174 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-68822c6e-3600-4c3e-b7d3-f15eba43804b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:50.399802 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-68822c6e-3600-4c3e-b7d3-f15eba43804b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:50.400480 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-68822c6e-3600-4c3e-b7d3-f15eba43804b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:50.467017 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-fbcb5f3b-7c4c-46a5-9cf6-f036433b41a4 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:50.475691 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-fbcb5f3b-7c4c-46a5-9cf6-f036433b41a4 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1519 microversion: 2.1 time: 0.179165 Aug 31 13:05:50.489830 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 295/607] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:50 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1519 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:05:50.490038 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-68822c6e-3600-4c3e-b7d3-f15eba43804b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "POST /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec/action" status: 202 len: 0 microversion: 2.1 time: 0.090257 Aug 31 13:05:50.490038 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 313/608] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 31 13:05:50 2022] POST /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 13:05:50.490226 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3b23e8bc-6bf7-4093-8581-987f22f7c352 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:50.490226 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-3b23e8bc-6bf7-4093-8581-987f22f7c352 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:50.492616 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3b23e8bc-6bf7-4093-8581-987f22f7c352 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:50.493121 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3b23e8bc-6bf7-4093-8581-987f22f7c352 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:50.493553 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3b23e8bc-6bf7-4093-8581-987f22f7c352 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:50.494265 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3b23e8bc-6bf7-4093-8581-987f22f7c352 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:50.494714 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3b23e8bc-6bf7-4093-8581-987f22f7c352 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:50.495129 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3b23e8bc-6bf7-4093-8581-987f22f7c352 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:50.634595 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-3b23e8bc-6bf7-4093-8581-987f22f7c352 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:50.644752 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-3b23e8bc-6bf7-4093-8581-987f22f7c352 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1722 microversion: 2.1 time: 0.162631 Aug 31 13:05:50.645636 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 296/609] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:50 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:05:51.280278 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-a41d6f8b-ee78-4301-9dce-f0df26ab39c4 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:51.280939 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-a41d6f8b-ee78-4301-9dce-f0df26ab39c4 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:51.288699 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a41d6f8b-ee78-4301-9dce-f0df26ab39c4 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:51.289319 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a41d6f8b-ee78-4301-9dce-f0df26ab39c4 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:51.289754 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a41d6f8b-ee78-4301-9dce-f0df26ab39c4 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:51.290449 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a41d6f8b-ee78-4301-9dce-f0df26ab39c4 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:51.291005 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a41d6f8b-ee78-4301-9dce-f0df26ab39c4 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:51.291449 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a41d6f8b-ee78-4301-9dce-f0df26ab39c4 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:51.423252 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-a41d6f8b-ee78-4301-9dce-f0df26ab39c4 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:51.431405 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-a41d6f8b-ee78-4301-9dce-f0df26ab39c4 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1664 microversion: 2.1 time: 0.155996 Aug 31 13:05:51.432044 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 314/610] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:51 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1664 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:51.501560 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e4cde9de-3b95-4705-912d-b5de08719d35 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:51.502515 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e4cde9de-3b95-4705-912d-b5de08719d35 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:51.513533 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e4cde9de-3b95-4705-912d-b5de08719d35 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:51.514318 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e4cde9de-3b95-4705-912d-b5de08719d35 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:51.515019 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e4cde9de-3b95-4705-912d-b5de08719d35 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:51.516214 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e4cde9de-3b95-4705-912d-b5de08719d35 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:51.516954 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e4cde9de-3b95-4705-912d-b5de08719d35 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:51.517662 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e4cde9de-3b95-4705-912d-b5de08719d35 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:51.661276 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e4cde9de-3b95-4705-912d-b5de08719d35 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:51.667431 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-65b4118d-d2cb-4de7-a3c9-f6734f4021a0 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:51.668062 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-65b4118d-d2cb-4de7-a3c9-f6734f4021a0 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:51.670137 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e4cde9de-3b95-4705-912d-b5de08719d35 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1575 microversion: 2.1 time: 0.174998 Aug 31 13:05:51.671208 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 297/611] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:51 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1575 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:51.675173 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-65b4118d-d2cb-4de7-a3c9-f6734f4021a0 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:51.675792 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-65b4118d-d2cb-4de7-a3c9-f6734f4021a0 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:51.676302 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-65b4118d-d2cb-4de7-a3c9-f6734f4021a0 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:51.676953 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-65b4118d-d2cb-4de7-a3c9-f6734f4021a0 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:51.677430 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-65b4118d-d2cb-4de7-a3c9-f6734f4021a0 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:51.677847 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-65b4118d-d2cb-4de7-a3c9-f6734f4021a0 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:51.812789 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-65b4118d-d2cb-4de7-a3c9-f6734f4021a0 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:51.821291 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-65b4118d-d2cb-4de7-a3c9-f6734f4021a0 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1722 microversion: 2.1 time: 0.158056 Aug 31 13:05:51.821863 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 315/612] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:51 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:52.452976 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-01068524-2746-4582-8662-e6e286fa1343 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:52.453581 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-01068524-2746-4582-8662-e6e286fa1343 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:52.460210 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-01068524-2746-4582-8662-e6e286fa1343 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:52.460691 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-01068524-2746-4582-8662-e6e286fa1343 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:52.461145 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-01068524-2746-4582-8662-e6e286fa1343 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:52.461804 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-01068524-2746-4582-8662-e6e286fa1343 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:52.462251 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-01068524-2746-4582-8662-e6e286fa1343 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:52.462667 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-01068524-2746-4582-8662-e6e286fa1343 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:52.607870 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-01068524-2746-4582-8662-e6e286fa1343 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:52.618154 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-01068524-2746-4582-8662-e6e286fa1343 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1668 microversion: 2.1 time: 0.169083 Aug 31 13:05:52.618890 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 298/613] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:52 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1668 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:52.692377 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-fe547dcd-b657-4c28-8769-49e01c9d0f6d tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:52.693066 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-fe547dcd-b657-4c28-8769-49e01c9d0f6d tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:52.700769 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fe547dcd-b657-4c28-8769-49e01c9d0f6d tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:52.701335 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fe547dcd-b657-4c28-8769-49e01c9d0f6d tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:52.701834 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fe547dcd-b657-4c28-8769-49e01c9d0f6d tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:52.702618 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fe547dcd-b657-4c28-8769-49e01c9d0f6d tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:52.703208 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fe547dcd-b657-4c28-8769-49e01c9d0f6d tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:52.703606 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fe547dcd-b657-4c28-8769-49e01c9d0f6d tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:52.836285 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-fe547dcd-b657-4c28-8769-49e01c9d0f6d tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:52.844792 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-fe547dcd-b657-4c28-8769-49e01c9d0f6d tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1575 microversion: 2.1 time: 0.156849 Aug 31 13:05:52.845348 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 316/614] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:52 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:52.846651 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-8a607966-5da4-4a14-adc9-20f0385711cb tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:52.847256 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-8a607966-5da4-4a14-adc9-20f0385711cb tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:52.853707 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8a607966-5da4-4a14-adc9-20f0385711cb tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:52.854176 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8a607966-5da4-4a14-adc9-20f0385711cb tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:52.854610 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8a607966-5da4-4a14-adc9-20f0385711cb tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:52.855327 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8a607966-5da4-4a14-adc9-20f0385711cb tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:52.855771 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8a607966-5da4-4a14-adc9-20f0385711cb tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:52.856226 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8a607966-5da4-4a14-adc9-20f0385711cb tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:53.001000 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-8a607966-5da4-4a14-adc9-20f0385711cb tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:53.009939 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-8a607966-5da4-4a14-adc9-20f0385711cb tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1722 microversion: 2.1 time: 0.167076 Aug 31 13:05:53.010575 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 299/615] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:52 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:53.868563 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-59b7f937-69d3-4c9d-8c05-4144afc604fd tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:53.869285 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-59b7f937-69d3-4c9d-8c05-4144afc604fd tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:53.877703 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-59b7f937-69d3-4c9d-8c05-4144afc604fd tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:53.878301 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-59b7f937-69d3-4c9d-8c05-4144afc604fd tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:53.878865 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-59b7f937-69d3-4c9d-8c05-4144afc604fd tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:53.879635 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-59b7f937-69d3-4c9d-8c05-4144afc604fd tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:53.880118 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-59b7f937-69d3-4c9d-8c05-4144afc604fd tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:53.880541 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-59b7f937-69d3-4c9d-8c05-4144afc604fd tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:54.027450 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-59b7f937-69d3-4c9d-8c05-4144afc604fd tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:54.030587 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-1003cf5e-48c3-4dad-80b9-ca2a237d741b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:54.031182 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-1003cf5e-48c3-4dad-80b9-ca2a237d741b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:54.037116 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-59b7f937-69d3-4c9d-8c05-4144afc604fd tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1575 microversion: 2.1 time: 0.173848 Aug 31 13:05:54.038006 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 317/616] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:53 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:54.038167 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1003cf5e-48c3-4dad-80b9-ca2a237d741b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:54.038437 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1003cf5e-48c3-4dad-80b9-ca2a237d741b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:54.038856 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1003cf5e-48c3-4dad-80b9-ca2a237d741b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:54.039518 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1003cf5e-48c3-4dad-80b9-ca2a237d741b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:54.039979 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1003cf5e-48c3-4dad-80b9-ca2a237d741b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:54.040392 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1003cf5e-48c3-4dad-80b9-ca2a237d741b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:54.176028 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-1003cf5e-48c3-4dad-80b9-ca2a237d741b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:54.188436 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-1003cf5e-48c3-4dad-80b9-ca2a237d741b tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1722 microversion: 2.1 time: 0.161378 Aug 31 13:05:54.189281 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 300/617] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:54 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:55.061799 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-e4f6c625-8348-4003-b397-e7851617fce6 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:55.062576 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-e4f6c625-8348-4003-b397-e7851617fce6 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:55.073053 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e4f6c625-8348-4003-b397-e7851617fce6 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:55.073757 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e4f6c625-8348-4003-b397-e7851617fce6 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:55.074425 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e4f6c625-8348-4003-b397-e7851617fce6 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:55.075500 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e4f6c625-8348-4003-b397-e7851617fce6 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:55.076259 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e4f6c625-8348-4003-b397-e7851617fce6 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:55.076952 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e4f6c625-8348-4003-b397-e7851617fce6 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:55.211185 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-1eac937a-54a8-46cf-b0a3-2aa7f883a7fd tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:55.211736 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-1eac937a-54a8-46cf-b0a3-2aa7f883a7fd tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:55.218006 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1eac937a-54a8-46cf-b0a3-2aa7f883a7fd tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:55.218483 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1eac937a-54a8-46cf-b0a3-2aa7f883a7fd tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:55.218912 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1eac937a-54a8-46cf-b0a3-2aa7f883a7fd tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:55.219618 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1eac937a-54a8-46cf-b0a3-2aa7f883a7fd tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:55.220075 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1eac937a-54a8-46cf-b0a3-2aa7f883a7fd tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:55.220493 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1eac937a-54a8-46cf-b0a3-2aa7f883a7fd tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:55.221994 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-e4f6c625-8348-4003-b397-e7851617fce6 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:55.230112 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-e4f6c625-8348-4003-b397-e7851617fce6 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1575 microversion: 2.1 time: 0.174343 Aug 31 13:05:55.230685 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 318/618] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:55 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:55.347805 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-1eac937a-54a8-46cf-b0a3-2aa7f883a7fd tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:55.357086 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-1eac937a-54a8-46cf-b0a3-2aa7f883a7fd tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1722 microversion: 2.1 time: 0.150083 Aug 31 13:05:55.357663 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 301/619] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:55 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:56.254615 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-155c60fc-1d2f-4aef-87a6-f4297e5ca716 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:56.255327 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-155c60fc-1d2f-4aef-87a6-f4297e5ca716 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:56.263215 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-155c60fc-1d2f-4aef-87a6-f4297e5ca716 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:56.263768 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-155c60fc-1d2f-4aef-87a6-f4297e5ca716 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:56.264316 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-155c60fc-1d2f-4aef-87a6-f4297e5ca716 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:56.265114 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-155c60fc-1d2f-4aef-87a6-f4297e5ca716 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:56.265636 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-155c60fc-1d2f-4aef-87a6-f4297e5ca716 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:56.266124 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-155c60fc-1d2f-4aef-87a6-f4297e5ca716 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:56.378682 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-57d0a1dd-8c84-4410-9876-6be65c1fee47 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:56.379485 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-57d0a1dd-8c84-4410-9876-6be65c1fee47 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:56.382012 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:05:56.393323 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-57d0a1dd-8c84-4410-9876-6be65c1fee47 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:56.393736 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-57d0a1dd-8c84-4410-9876-6be65c1fee47 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:56.394236 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-57d0a1dd-8c84-4410-9876-6be65c1fee47 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:56.394998 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-57d0a1dd-8c84-4410-9876-6be65c1fee47 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:56.395459 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-57d0a1dd-8c84-4410-9876-6be65c1fee47 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:56.396269 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-57d0a1dd-8c84-4410-9876-6be65c1fee47 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:56.430905 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-155c60fc-1d2f-4aef-87a6-f4297e5ca716 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:56.442869 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-155c60fc-1d2f-4aef-87a6-f4297e5ca716 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1575 microversion: 2.1 time: 0.191846 Aug 31 13:05:56.443840 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 319/620] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:56 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1575 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:56.533675 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-57d0a1dd-8c84-4410-9876-6be65c1fee47 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:56.546232 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-57d0a1dd-8c84-4410-9876-6be65c1fee47 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1728 microversion: 2.1 time: 0.171110 Aug 31 13:05:56.546969 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 302/621] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:56 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:56.568186 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-fb1d8091-62f3-4db7-9ff8-05dff3077059 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:56.568666 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-fb1d8091-62f3-4db7-9ff8-05dff3077059 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:56.575001 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fb1d8091-62f3-4db7-9ff8-05dff3077059 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:56.575469 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fb1d8091-62f3-4db7-9ff8-05dff3077059 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:56.575938 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fb1d8091-62f3-4db7-9ff8-05dff3077059 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:56.576621 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fb1d8091-62f3-4db7-9ff8-05dff3077059 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:56.577066 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fb1d8091-62f3-4db7-9ff8-05dff3077059 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:56.577485 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fb1d8091-62f3-4db7-9ff8-05dff3077059 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:56.656538 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-fb1d8091-62f3-4db7-9ff8-05dff3077059 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092141 Aug 31 13:05:56.657121 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 320/622] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 31 13:05:56 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:05:57.463951 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-63d79bd3-4bc5-4622-93d5-403e15cdc148 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:57.464553 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-63d79bd3-4bc5-4622-93d5-403e15cdc148 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:57.472332 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-63d79bd3-4bc5-4622-93d5-403e15cdc148 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:57.472811 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-63d79bd3-4bc5-4622-93d5-403e15cdc148 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:57.473228 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-63d79bd3-4bc5-4622-93d5-403e15cdc148 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:57.473924 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-63d79bd3-4bc5-4622-93d5-403e15cdc148 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:57.474372 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-63d79bd3-4bc5-4622-93d5-403e15cdc148 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:57.474793 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-63d79bd3-4bc5-4622-93d5-403e15cdc148 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:57.687972 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-63d79bd3-4bc5-4622-93d5-403e15cdc148 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:57.696145 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-63d79bd3-4bc5-4622-93d5-403e15cdc148 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1575 microversion: 2.1 time: 0.236066 Aug 31 13:05:57.696951 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 303/623] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:57 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1575 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:57.921029 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-de32966b-7010-458a-9714-31312357e425 req-5801932f-9a18-48cb-b132-9ff7b6e232b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec", "tag": "d45b253a-763d-4df7-b467-4cfc91042795"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:05:57.930692 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-de32966b-7010-458a-9714-31312357e425 req-5801932f-9a18-48cb-b132-9ff7b6e232b7 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:57.931145 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-de32966b-7010-458a-9714-31312357e425 req-5801932f-9a18-48cb-b132-9ff7b6e232b7 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:57.931551 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-de32966b-7010-458a-9714-31312357e425 req-5801932f-9a18-48cb-b132-9ff7b6e232b7 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:57.943677 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-de32966b-7010-458a-9714-31312357e425 req-5801932f-9a18-48cb-b132-9ff7b6e232b7 service nova] Creating event network-changed:d45b253a-763d-4df7-b467-4cfc91042795 for instance dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec on hv-cinder-85442 Aug 31 13:05:57.949058 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-de32966b-7010-458a-9714-31312357e425 req-5801932f-9a18-48cb-b132-9ff7b6e232b7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088068 Aug 31 13:05:57.949749 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 321/624] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:05:58.717800 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-2152806b-6ad2-4d04-9cfa-7c8d933f51db tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:58.718523 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-2152806b-6ad2-4d04-9cfa-7c8d933f51db tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:58.725622 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2152806b-6ad2-4d04-9cfa-7c8d933f51db tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:58.726049 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2152806b-6ad2-4d04-9cfa-7c8d933f51db tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:58.726584 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2152806b-6ad2-4d04-9cfa-7c8d933f51db tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:58.727390 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2152806b-6ad2-4d04-9cfa-7c8d933f51db tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:58.727940 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2152806b-6ad2-4d04-9cfa-7c8d933f51db tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:58.728422 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2152806b-6ad2-4d04-9cfa-7c8d933f51db tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:58.863229 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-2152806b-6ad2-4d04-9cfa-7c8d933f51db tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:05:58.871678 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-2152806b-6ad2-4d04-9cfa-7c8d933f51db tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1575 microversion: 2.1 time: 0.157784 Aug 31 13:05:58.872261 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 304/625] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:58 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:05:59.900968 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-31a102d0-875c-4153-876c-19465c1d193b tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:05:59.901660 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-31a102d0-875c-4153-876c-19465c1d193b tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:05:59.908220 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-31a102d0-875c-4153-876c-19465c1d193b tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:59.908691 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-31a102d0-875c-4153-876c-19465c1d193b tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:59.909119 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-31a102d0-875c-4153-876c-19465c1d193b tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:59.909798 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-31a102d0-875c-4153-876c-19465c1d193b tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:59.910281 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-31a102d0-875c-4153-876c-19465c1d193b tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:59.910693 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-31a102d0-875c-4153-876c-19465c1d193b tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:59.963521 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-3fd242ba-b24b-4ddd-b522-6606631a181c req-bf3efa6a-f71b-4104-9845-3cdd986fa0ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec", "tag": "d45b253a-763d-4df7-b467-4cfc91042795"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:05:59.973823 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-3fd242ba-b24b-4ddd-b522-6606631a181c req-bf3efa6a-f71b-4104-9845-3cdd986fa0ca service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:05:59.974298 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-3fd242ba-b24b-4ddd-b522-6606631a181c req-bf3efa6a-f71b-4104-9845-3cdd986fa0ca service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:05:59.974711 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-3fd242ba-b24b-4ddd-b522-6606631a181c req-bf3efa6a-f71b-4104-9845-3cdd986fa0ca service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:05:59.985845 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-3fd242ba-b24b-4ddd-b522-6606631a181c req-bf3efa6a-f71b-4104-9845-3cdd986fa0ca service nova] Creating event network-changed:d45b253a-763d-4df7-b467-4cfc91042795 for instance dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec on hv-cinder-85442 Aug 31 13:05:59.991141 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-3fd242ba-b24b-4ddd-b522-6606631a181c req-bf3efa6a-f71b-4104-9845-3cdd986fa0ca service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031343 Aug 31 13:05:59.991743 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 305/626] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:06:00.048913 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-31a102d0-875c-4153-876c-19465c1d193b tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:06:00.057761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-31a102d0-875c-4153-876c-19465c1d193b tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1575 microversion: 2.1 time: 0.161559 Aug 31 13:06:00.058353 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 322/627] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:05:59 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:06:01.084640 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-22252548-8660-42bc-89d5-d6e8b7e5a632 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:06:01.085323 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-22252548-8660-42bc-89d5-d6e8b7e5a632 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:06:01.092736 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-22252548-8660-42bc-89d5-d6e8b7e5a632 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:01.093261 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-22252548-8660-42bc-89d5-d6e8b7e5a632 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:01.093742 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-22252548-8660-42bc-89d5-d6e8b7e5a632 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:01.094475 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-22252548-8660-42bc-89d5-d6e8b7e5a632 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:01.094977 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-22252548-8660-42bc-89d5-d6e8b7e5a632 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:01.095441 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-22252548-8660-42bc-89d5-d6e8b7e5a632 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:01.247781 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-22252548-8660-42bc-89d5-d6e8b7e5a632 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:06:01.259803 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-22252548-8660-42bc-89d5-d6e8b7e5a632 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1575 microversion: 2.1 time: 0.182058 Aug 31 13:06:01.260730 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 306/628] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:06:01 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1575 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:06:02.285719 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-8929b869-c77f-49f9-81c3-56d381dbffdb tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:06:02.286251 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-8929b869-c77f-49f9-81c3-56d381dbffdb tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:06:02.293199 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8929b869-c77f-49f9-81c3-56d381dbffdb tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:02.293669 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8929b869-c77f-49f9-81c3-56d381dbffdb tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:02.294089 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8929b869-c77f-49f9-81c3-56d381dbffdb tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:02.294763 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8929b869-c77f-49f9-81c3-56d381dbffdb tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:02.295197 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8929b869-c77f-49f9-81c3-56d381dbffdb tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:02.295608 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8929b869-c77f-49f9-81c3-56d381dbffdb tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:02.437781 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-8929b869-c77f-49f9-81c3-56d381dbffdb tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:06:02.445853 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-8929b869-c77f-49f9-81c3-56d381dbffdb tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1575 microversion: 2.1 time: 0.164568 Aug 31 13:06:02.446432 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 323/629] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:06:02 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:06:03.470472 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-99b86643-4aa6-4818-abb0-e47f2a9c1958 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:06:03.471438 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-99b86643-4aa6-4818-abb0-e47f2a9c1958 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:06:03.482363 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-99b86643-4aa6-4818-abb0-e47f2a9c1958 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:03.483143 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-99b86643-4aa6-4818-abb0-e47f2a9c1958 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:03.483894 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-99b86643-4aa6-4818-abb0-e47f2a9c1958 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:03.485059 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-99b86643-4aa6-4818-abb0-e47f2a9c1958 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:03.486087 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-99b86643-4aa6-4818-abb0-e47f2a9c1958 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:03.486668 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-99b86643-4aa6-4818-abb0-e47f2a9c1958 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:03.505568 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:03.632560 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-99b86643-4aa6-4818-abb0-e47f2a9c1958 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:06:03.640806 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-99b86643-4aa6-4818-abb0-e47f2a9c1958 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1575 microversion: 2.1 time: 0.177243 Aug 31 13:06:03.641383 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 307/630] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:06:03 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1575 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:06:04.662166 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-c78f051b-c44a-420f-ac5b-5941cd6d5789 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:06:04.662798 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-c78f051b-c44a-420f-ac5b-5941cd6d5789 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:06:04.669746 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c78f051b-c44a-420f-ac5b-5941cd6d5789 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:04.670224 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c78f051b-c44a-420f-ac5b-5941cd6d5789 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:04.670659 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c78f051b-c44a-420f-ac5b-5941cd6d5789 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:04.671358 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c78f051b-c44a-420f-ac5b-5941cd6d5789 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:04.671799 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c78f051b-c44a-420f-ac5b-5941cd6d5789 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:04.672254 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c78f051b-c44a-420f-ac5b-5941cd6d5789 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:04.690502 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:04.804449 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-c78f051b-c44a-420f-ac5b-5941cd6d5789 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:06:04.813104 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-c78f051b-c44a-420f-ac5b-5941cd6d5789 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1575 microversion: 2.1 time: 0.155334 Aug 31 13:06:04.813692 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 324/631] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:06:04 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:06:05.834482 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-6f52bb3f-4887-420d-8c72-4c10ac3e8afb tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:06:05.835087 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-6f52bb3f-4887-420d-8c72-4c10ac3e8afb tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:06:05.842331 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6f52bb3f-4887-420d-8c72-4c10ac3e8afb tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:05.842826 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6f52bb3f-4887-420d-8c72-4c10ac3e8afb tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:05.843257 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6f52bb3f-4887-420d-8c72-4c10ac3e8afb tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:05.843999 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6f52bb3f-4887-420d-8c72-4c10ac3e8afb tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:05.844447 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6f52bb3f-4887-420d-8c72-4c10ac3e8afb tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:05.844894 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6f52bb3f-4887-420d-8c72-4c10ac3e8afb tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:05.986125 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-6f52bb3f-4887-420d-8c72-4c10ac3e8afb tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:06:05.994072 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-6f52bb3f-4887-420d-8c72-4c10ac3e8afb tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1575 microversion: 2.1 time: 0.163567 Aug 31 13:06:05.994676 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 308/632] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:06:05 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:06:07.019070 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-f7fdba86-4bdd-470d-b0df-4acb64bb7c34 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:06:07.019870 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-f7fdba86-4bdd-470d-b0df-4acb64bb7c34 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:06:07.026673 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f7fdba86-4bdd-470d-b0df-4acb64bb7c34 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:07.027161 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f7fdba86-4bdd-470d-b0df-4acb64bb7c34 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:07.027625 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f7fdba86-4bdd-470d-b0df-4acb64bb7c34 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:07.028356 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f7fdba86-4bdd-470d-b0df-4acb64bb7c34 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:07.028802 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f7fdba86-4bdd-470d-b0df-4acb64bb7c34 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:07.029224 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f7fdba86-4bdd-470d-b0df-4acb64bb7c34 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:07.163225 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-f7fdba86-4bdd-470d-b0df-4acb64bb7c34 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:06:07.171231 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-f7fdba86-4bdd-470d-b0df-4acb64bb7c34 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1575 microversion: 2.1 time: 0.158948 Aug 31 13:06:07.171855 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 325/633] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:06:07 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:06:08.194858 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-9b705f88-95de-4c5d-91c7-159d4b947a08 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:06:08.195470 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-9b705f88-95de-4c5d-91c7-159d4b947a08 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:06:08.202012 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9b705f88-95de-4c5d-91c7-159d4b947a08 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:08.202498 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9b705f88-95de-4c5d-91c7-159d4b947a08 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:08.202935 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9b705f88-95de-4c5d-91c7-159d4b947a08 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:08.203629 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9b705f88-95de-4c5d-91c7-159d4b947a08 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:08.204115 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9b705f88-95de-4c5d-91c7-159d4b947a08 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:08.204517 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9b705f88-95de-4c5d-91c7-159d4b947a08 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:08.335365 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-9b705f88-95de-4c5d-91c7-159d4b947a08 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:06:08.343223 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-9b705f88-95de-4c5d-91c7-159d4b947a08 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1575 microversion: 2.1 time: 0.152965 Aug 31 13:06:08.343796 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 309/634] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:06:08 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:06:08.348239 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-ebf6b645-92d1-470b-a8b6-a4f5e12645c9 req-65cac0da-37ce-4b32-b30f-448c1b2e8cc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e792077-8a21-48f8-8f65-ce1a4aae8c0a", "name": "network-vif-plugged", "status": "completed", "tag": "22506bf3-0225-4ad3-b8d6-55645f334201"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:06:08.358737 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-ebf6b645-92d1-470b-a8b6-a4f5e12645c9 req-65cac0da-37ce-4b32-b30f-448c1b2e8cc5 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:08.358978 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-ebf6b645-92d1-470b-a8b6-a4f5e12645c9 req-65cac0da-37ce-4b32-b30f-448c1b2e8cc5 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:08.359399 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-ebf6b645-92d1-470b-a8b6-a4f5e12645c9 req-65cac0da-37ce-4b32-b30f-448c1b2e8cc5 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:08.370634 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-ebf6b645-92d1-470b-a8b6-a4f5e12645c9 req-65cac0da-37ce-4b32-b30f-448c1b2e8cc5 service nova] Creating event network-vif-plugged:22506bf3-0225-4ad3-b8d6-55645f334201 for instance 9e792077-8a21-48f8-8f65-ce1a4aae8c0a on hv-cinder-85442 Aug 31 13:06:08.375497 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-ebf6b645-92d1-470b-a8b6-a4f5e12645c9 req-65cac0da-37ce-4b32-b30f-448c1b2e8cc5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031032 Aug 31 13:06:08.376336 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 326/635] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:06:09.367446 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-7c7d942e-ccec-4ff7-9fc2-428fd5f02f66 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:06:09.368163 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-7c7d942e-ccec-4ff7-9fc2-428fd5f02f66 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:06:09.376596 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7c7d942e-ccec-4ff7-9fc2-428fd5f02f66 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:09.377155 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7c7d942e-ccec-4ff7-9fc2-428fd5f02f66 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:09.377659 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7c7d942e-ccec-4ff7-9fc2-428fd5f02f66 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:09.378496 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7c7d942e-ccec-4ff7-9fc2-428fd5f02f66 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:09.379379 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7c7d942e-ccec-4ff7-9fc2-428fd5f02f66 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:09.380211 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7c7d942e-ccec-4ff7-9fc2-428fd5f02f66 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:09.522666 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-7c7d942e-ccec-4ff7-9fc2-428fd5f02f66 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:06:09.530821 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-7c7d942e-ccec-4ff7-9fc2-428fd5f02f66 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1575 microversion: 2.1 time: 0.168295 Aug 31 13:06:09.531394 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 310/636] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:06:09 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:06:10.556458 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-c2365438-df79-4b08-94d6-f78c4d4edf3a tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:06:10.557300 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-c2365438-df79-4b08-94d6-f78c4d4edf3a tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:06:10.564071 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c2365438-df79-4b08-94d6-f78c4d4edf3a tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:10.564551 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c2365438-df79-4b08-94d6-f78c4d4edf3a tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:10.564985 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c2365438-df79-4b08-94d6-f78c4d4edf3a tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:10.565677 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c2365438-df79-4b08-94d6-f78c4d4edf3a tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:10.566230 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c2365438-df79-4b08-94d6-f78c4d4edf3a tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:10.566651 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c2365438-df79-4b08-94d6-f78c4d4edf3a tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:10.711141 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-c2365438-df79-4b08-94d6-f78c4d4edf3a tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:06:10.719119 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-c2365438-df79-4b08-94d6-f78c4d4edf3a tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1562 microversion: 2.1 time: 0.167501 Aug 31 13:06:10.719674 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 327/637] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:06:10 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1562 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:06:22.059098 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=17 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:22.059923 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=20 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:22.170151 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-4f0fc354-1c3a-46f3-947f-25755d4b1b96 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:06:22.170635 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-4f0fc354-1c3a-46f3-947f-25755d4b1b96 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:06:22.177080 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4f0fc354-1c3a-46f3-947f-25755d4b1b96 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:22.177558 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4f0fc354-1c3a-46f3-947f-25755d4b1b96 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:22.177989 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4f0fc354-1c3a-46f3-947f-25755d4b1b96 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:22.178674 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4f0fc354-1c3a-46f3-947f-25755d4b1b96 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:22.179115 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4f0fc354-1c3a-46f3-947f-25755d4b1b96 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:22.179535 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4f0fc354-1c3a-46f3-947f-25755d4b1b96 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:22.207062 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-4f0fc354-1c3a-46f3-947f-25755d4b1b96 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e/ips" status: 200 len: 148 microversion: 2.1 time: 0.155542 Aug 31 13:06:22.207538 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 311/638] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 31 13:06:22 2022] GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e/ips => generated 148 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:06:22.219628 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-1cf60919-e3d0-41a5-b0a5-9c4939ceb495 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8680ae01-8489-42f5-b63f-622cda4dcf14"}} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:06:22.221927 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-1cf60919-e3d0-41a5-b0a5-9c4939ceb495 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:06:22.224855 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 13:06:22.225011 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Wed Aug 31 13:06:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e/os-volume_attachments (ip 10.222.0.58) !!! Aug 31 13:06:22.225921 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_api:SELECT=41 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:22.226786 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell1:SELECT=16 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:22.234524 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1cf60919-e3d0-41a5-b0a5-9c4939ceb495 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:22.234989 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1cf60919-e3d0-41a5-b0a5-9c4939ceb495 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:22.235410 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1cf60919-e3d0-41a5-b0a5-9c4939ceb495 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:22.236129 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1cf60919-e3d0-41a5-b0a5-9c4939ceb495 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:22.236567 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1cf60919-e3d0-41a5-b0a5-9c4939ceb495 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:22.236985 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1cf60919-e3d0-41a5-b0a5-9c4939ceb495 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:22.319342 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.wsgi [None req-1cf60919-e3d0-41a5-b0a5-9c4939ceb495 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] HTTP exception thrown: Invalid volume: volume 8680ae01-8489-42f5-b63f-622cda4dcf14 is already attached to instances: ba62b7ce-5880-4281-a5a4-020d70e5b16d Aug 31 13:06:22.321124 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-1cf60919-e3d0-41a5-b0a5-9c4939ceb495 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Request method failure captured: Aug 31 13:06:22.321124 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: request: POST /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e/os-volume_attachments HTTP/1.1 Aug 31 13:06:22.321124 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept: application/json Aug 31 13:06:22.321124 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept-Encoding: identity Aug 31 13:06:22.321124 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Connection: close Aug 31 13:06:22.321124 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Length: 74 Aug 31 13:06:22.321124 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Type: application/json Aug 31 13:06:22.321124 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Host: 10.222.0.58 Aug 31 13:06:22.321124 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Openstack-System-Scope: None Aug 31 13:06:22.321124 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: User-Agent: python-urllib3/1.26.12 Aug 31 13:06:22.321124 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Auth-Token: gAAAAABjD1uCNSnUQPMlQgFT2jq-eB19r7xLb94uzxGnoJXWTepSWTo7UQTZU86dPbIoFZ8qqdn2aU_O4yRfHOsmgtmeK9yuhxtC117CeRP8ROwyQq4z33BXiou8fAPjfT5vF29_iKZcD17NL5FwHgpz6cSqA2AiwZ_XLORdaExhfMVopvwp8pU Aug 31 13:06:22.321124 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Id: None Aug 31 13:06:22.321124 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Name: None Aug 31 13:06:22.321124 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Identity-Status: Confirmed Aug 31 13:06:22.321124 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Is-Admin-Project: True Aug 31 13:06:22.321124 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Id: default Aug 31 13:06:22.321124 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Name: Default Aug 31 13:06:22.321124 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Id: fdf85a7b31004baf848842ad2f74cbf0 Aug 31 13:06:22.321124 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Name: tempest-AttachVolumeNegativeTest-2039526226 Aug 31 13:06:22.321124 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Role: member,reader Aug 31 13:06:22.321124 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Roles: member,reader Aug 31 13:06:22.322952 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fdf85a7b31004baf848842ad2f74cbf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fdf85a7b31004baf848842ad2f74cbf0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fdf85a7b31004baf848842ad2f74cbf0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fdf85a7b31004baf848842ad2f74cbf0"}]}] Aug 31 13:06:22.322952 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant: tempest-AttachVolumeNegativeTest-2039526226 Aug 31 13:06:22.322952 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Id: fdf85a7b31004baf848842ad2f74cbf0 Aug 31 13:06:22.322952 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2039526226 Aug 31 13:06:22.322952 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User: tempest-AttachVolumeNegativeTest-2039526226-project Aug 31 13:06:22.322952 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Id: default Aug 31 13:06:22.322952 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Name: Default Aug 31 13:06:22.322952 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Id: ac2a50988be24e20be034777225d8106 Aug 31 13:06:22.322952 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Name: tempest-AttachVolumeNegativeTest-2039526226-project Aug 31 13:06:22.322952 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Aug 31 13:06:22.322952 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: {"volumeAttachment": {"volumeId": "8680ae01-8489-42f5-b63f-622cda4dcf14"}} Aug 31 13:06:22.322952 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: method: > Aug 31 13:06:22.324040 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: exception: Invalid volume: volume 8680ae01-8489-42f5-b63f-622cda4dcf14 is already attached to instances: ba62b7ce-5880-4281-a5a4-020d70e5b16d Aug 31 13:06:22.324040 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: action_args: {'server_id': 'ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e', 'body': {'volumeAttachment': {'volumeId': '8680ae01-8489-42f5-b63f-622cda4dcf14'}}} Aug 31 13:06:22.324040 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:06:22.324040 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:06:22.324040 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 13:06:22.324040 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 13:06:22.324040 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 13:06:22.324040 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 13:06:22.324040 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 13:06:22.324040 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 13:06:22.324040 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 31 13:06:22.324040 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 31 13:06:22.324040 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 31 13:06:22.324040 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 31 13:06:22.324040 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8680ae01-8489-42f5-b63f-622cda4dcf14 is already attached to instances: ba62b7ce-5880-4281-a5a4-020d70e5b16d Aug 31 13:06:22.324040 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:06:22.324040 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:06:22.324040 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:06:22.324040 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:06:22.325493 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:06:22.325493 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:06:22.325493 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:06:22.325493 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:06:22.325493 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:06:22.325493 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:06:22.325493 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 13:06:22.325493 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 13:06:22.325493 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 13:06:22.325493 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 13:06:22.325493 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 13:06:22.325493 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 13:06:22.325493 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 31 13:06:22.325493 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 13:06:22.325493 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8680ae01-8489-42f5-b63f-622cda4dcf14 is already attached to instances: ba62b7ce-5880-4281-a5a4-020d70e5b16d Aug 31 13:06:22.325493 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:06:22.325493 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:06:22.325493 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:06:22.325493 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:06:22.325493 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:06:22.327069 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:06:22.327069 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:06:22.327069 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:06:22.327069 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8680ae01-8489-42f5-b63f-622cda4dcf14 is already attached to instances: ba62b7ce-5880-4281-a5a4-020d70e5b16d Aug 31 13:06:22.327069 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:06:22.327069 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-1cf60919-e3d0-41a5-b0a5-9c4939ceb495 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Returning 400 to user: Invalid volume: volume 8680ae01-8489-42f5-b63f-622cda4dcf14 is already attached to instances: ba62b7ce-5880-4281-a5a4-020d70e5b16d {{(pid=120704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:06:22.327069 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-1cf60919-e3d0-41a5-b0a5-9c4939ceb495 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "POST /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107162 Aug 31 13:06:22.327069 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 328/639] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 31 13:06:22 2022] POST /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 13:06:22.331573 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-0cdc956a-c5c9-49b6-a672-4af9201a6263 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:06:22.332098 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-0cdc956a-c5c9-49b6-a672-4af9201a6263 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:06:22.338280 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0cdc956a-c5c9-49b6-a672-4af9201a6263 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:22.338745 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0cdc956a-c5c9-49b6-a672-4af9201a6263 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:22.339172 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0cdc956a-c5c9-49b6-a672-4af9201a6263 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:22.339876 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0cdc956a-c5c9-49b6-a672-4af9201a6263 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:22.340322 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0cdc956a-c5c9-49b6-a672-4af9201a6263 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:22.340737 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0cdc956a-c5c9-49b6-a672-4af9201a6263 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:22.365663 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-0cdc956a-c5c9-49b6-a672-4af9201a6263 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e] Going to try to terminate instance {{(pid=120705) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 13:06:22.462459 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-0cdc956a-c5c9-49b6-a672-4af9201a6263 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e" status: 204 len: 0 microversion: 2.1 time: 0.134429 Aug 31 13:06:22.463143 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 312/640] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 31 13:06:22 2022] DELETE /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:06:22.472511 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-b0cd16ea-76bc-4fd0-b492-0630d8f9a1d6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:06:22.473240 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-b0cd16ea-76bc-4fd0-b492-0630d8f9a1d6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:06:22.480370 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b0cd16ea-76bc-4fd0-b492-0630d8f9a1d6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:22.480846 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b0cd16ea-76bc-4fd0-b492-0630d8f9a1d6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:22.481274 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b0cd16ea-76bc-4fd0-b492-0630d8f9a1d6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:22.481967 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b0cd16ea-76bc-4fd0-b492-0630d8f9a1d6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:22.482452 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b0cd16ea-76bc-4fd0-b492-0630d8f9a1d6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:22.482838 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b0cd16ea-76bc-4fd0-b492-0630d8f9a1d6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:22.614887 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-b0cd16ea-76bc-4fd0-b492-0630d8f9a1d6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:06:22.625917 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-b0cd16ea-76bc-4fd0-b492-0630d8f9a1d6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e" status: 200 len: 1679 microversion: 2.1 time: 0.158020 Aug 31 13:06:22.626892 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 329/641] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:06:22 2022] GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:06:23.653026 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-85fbf2ac-5700-40ef-80cd-720af222d7d7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:06:23.653662 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-85fbf2ac-5700-40ef-80cd-720af222d7d7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:06:23.661059 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-85fbf2ac-5700-40ef-80cd-720af222d7d7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:23.661542 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-85fbf2ac-5700-40ef-80cd-720af222d7d7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:23.661973 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-85fbf2ac-5700-40ef-80cd-720af222d7d7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:23.662668 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-85fbf2ac-5700-40ef-80cd-720af222d7d7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:23.663117 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-85fbf2ac-5700-40ef-80cd-720af222d7d7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:23.663545 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-85fbf2ac-5700-40ef-80cd-720af222d7d7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:23.804164 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-85fbf2ac-5700-40ef-80cd-720af222d7d7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:06:23.812250 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-85fbf2ac-5700-40ef-80cd-720af222d7d7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e" status: 200 len: 1679 microversion: 2.1 time: 0.163637 Aug 31 13:06:23.812818 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 313/642] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:06:23 2022] GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:06:24.835890 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-db1b4ead-1216-4150-a18d-d0c127217133 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:06:24.836766 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-db1b4ead-1216-4150-a18d-d0c127217133 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:06:24.846677 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-db1b4ead-1216-4150-a18d-d0c127217133 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:24.847351 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-db1b4ead-1216-4150-a18d-d0c127217133 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:24.847770 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-db1b4ead-1216-4150-a18d-d0c127217133 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:24.848481 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-db1b4ead-1216-4150-a18d-d0c127217133 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:24.848915 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-db1b4ead-1216-4150-a18d-d0c127217133 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:24.849324 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-db1b4ead-1216-4150-a18d-d0c127217133 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:24.989760 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-db1b4ead-1216-4150-a18d-d0c127217133 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:06:24.998029 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-db1b4ead-1216-4150-a18d-d0c127217133 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e" status: 200 len: 1679 microversion: 2.1 time: 0.167751 Aug 31 13:06:24.998618 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 330/643] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:06:24 2022] GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:06:25.899946 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-f7081dbe-c5dd-47d3-b0b3-3b65c3ff9883 req-f692be1b-eff1-47db-97a5-89b941f5ca3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e", "name": "network-vif-deleted", "tag": "0223c49a-2ae0-45b1-8627-a290b23cfabb"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:06:25.911198 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-f7081dbe-c5dd-47d3-b0b3-3b65c3ff9883 req-f692be1b-eff1-47db-97a5-89b941f5ca3d service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:25.911658 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-f7081dbe-c5dd-47d3-b0b3-3b65c3ff9883 req-f692be1b-eff1-47db-97a5-89b941f5ca3d service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:25.912107 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-f7081dbe-c5dd-47d3-b0b3-3b65c3ff9883 req-f692be1b-eff1-47db-97a5-89b941f5ca3d service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:25.923526 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-f7081dbe-c5dd-47d3-b0b3-3b65c3ff9883 req-f692be1b-eff1-47db-97a5-89b941f5ca3d service nova] Creating event network-vif-deleted:0223c49a-2ae0-45b1-8627-a290b23cfabb for instance ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e on hv-cinder-85442 Aug 31 13:06:25.929103 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-f7081dbe-c5dd-47d3-b0b3-3b65c3ff9883 req-f692be1b-eff1-47db-97a5-89b941f5ca3d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032886 Aug 31 13:06:25.929711 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 314/644] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:06:26.020028 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-0591dd4e-1e29-4b6c-90ab-db78261343ca tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:06:26.020028 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-0591dd4e-1e29-4b6c-90ab-db78261343ca tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:06:26.027457 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0591dd4e-1e29-4b6c-90ab-db78261343ca tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:26.028274 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0591dd4e-1e29-4b6c-90ab-db78261343ca tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:26.028883 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0591dd4e-1e29-4b6c-90ab-db78261343ca tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:26.029865 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0591dd4e-1e29-4b6c-90ab-db78261343ca tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:26.031212 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0591dd4e-1e29-4b6c-90ab-db78261343ca tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:26.032030 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0591dd4e-1e29-4b6c-90ab-db78261343ca tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:26.067702 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0591dd4e-1e29-4b6c-90ab-db78261343ca tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:26.068223 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0591dd4e-1e29-4b6c-90ab-db78261343ca tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:26.068651 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0591dd4e-1e29-4b6c-90ab-db78261343ca tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:26.069115 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.objects.instance [None req-0591dd4e-1e29-4b6c-90ab-db78261343ca tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lazy-loading 'fault' on Instance uuid ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e {{(pid=120704) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 13:06:26.121661 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-0591dd4e-1e29-4b6c-90ab-db78261343ca tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:06:26.132757 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-0591dd4e-1e29-4b6c-90ab-db78261343ca tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e" status: 200 len: 1331 microversion: 2.1 time: 0.117725 Aug 31 13:06:26.140232 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 331/645] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:06:26 2022] GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e => generated 1331 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:06:27.155539 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-0f2aa2ee-9cd7-4620-a17a-8d4fd58f4d18 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:06:27.156366 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-0f2aa2ee-9cd7-4620-a17a-8d4fd58f4d18 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:06:27.163403 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0f2aa2ee-9cd7-4620-a17a-8d4fd58f4d18 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:27.164011 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0f2aa2ee-9cd7-4620-a17a-8d4fd58f4d18 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:27.164649 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0f2aa2ee-9cd7-4620-a17a-8d4fd58f4d18 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:27.165412 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0f2aa2ee-9cd7-4620-a17a-8d4fd58f4d18 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:27.165920 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0f2aa2ee-9cd7-4620-a17a-8d4fd58f4d18 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:27.166402 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0f2aa2ee-9cd7-4620-a17a-8d4fd58f4d18 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:27.180957 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-0f2aa2ee-9cd7-4620-a17a-8d4fd58f4d18 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] HTTP exception thrown: Instance ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e could not be found. Aug 31 13:06:27.182756 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-0f2aa2ee-9cd7-4620-a17a-8d4fd58f4d18 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Request method failure captured: Aug 31 13:06:27.182756 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: request: GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e HTTP/1.1 Aug 31 13:06:27.182756 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 31 13:06:27.182756 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 31 13:06:27.182756 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Connection: close Aug 31 13:06:27.182756 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 31 13:06:27.182756 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 31 13:06:27.182756 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Host: 10.222.0.58 Aug 31 13:06:27.182756 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 31 13:06:27.182756 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 31 13:06:27.182756 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjD1uCNSnUQPMlQgFT2jq-eB19r7xLb94uzxGnoJXWTepSWTo7UQTZU86dPbIoFZ8qqdn2aU_O4yRfHOsmgtmeK9yuhxtC117CeRP8ROwyQq4z33BXiou8fAPjfT5vF29_iKZcD17NL5FwHgpz6cSqA2AiwZ_XLORdaExhfMVopvwp8pU Aug 31 13:06:27.182756 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 31 13:06:27.182756 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 31 13:06:27.182756 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 31 13:06:27.182756 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 31 13:06:27.182756 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 31 13:06:27.182756 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 31 13:06:27.182756 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Id: fdf85a7b31004baf848842ad2f74cbf0 Aug 31 13:06:27.182756 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-AttachVolumeNegativeTest-2039526226 Aug 31 13:06:27.182756 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Role: member,reader Aug 31 13:06:27.182756 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Roles: member,reader Aug 31 13:06:27.184423 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fdf85a7b31004baf848842ad2f74cbf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fdf85a7b31004baf848842ad2f74cbf0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fdf85a7b31004baf848842ad2f74cbf0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fdf85a7b31004baf848842ad2f74cbf0"}]}] Aug 31 13:06:27.184423 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-AttachVolumeNegativeTest-2039526226 Aug 31 13:06:27.184423 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant-Id: fdf85a7b31004baf848842ad2f74cbf0 Aug 31 13:06:27.184423 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2039526226 Aug 31 13:06:27.184423 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User: tempest-AttachVolumeNegativeTest-2039526226-project Aug 31 13:06:27.184423 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 31 13:06:27.184423 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 31 13:06:27.184423 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Id: ac2a50988be24e20be034777225d8106 Aug 31 13:06:27.184423 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-AttachVolumeNegativeTest-2039526226-project Aug 31 13:06:27.184423 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: method: > Aug 31 13:06:27.184423 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: exception: Instance ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e could not be found. Aug 31 13:06:27.184423 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: action_args: {'id': 'ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e'} Aug 31 13:06:27.188837 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:06:27.188837 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:06:27.188837 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 13:06:27.188837 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 13:06:27.188837 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 13:06:27.188837 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 13:06:27.188837 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 13:06:27.188837 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 13:06:27.188837 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 13:06:27.188837 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 13:06:27.188837 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e could not be found. Aug 31 13:06:27.188837 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:06:27.188837 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:06:27.188837 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:06:27.188837 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:06:27.188837 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:06:27.188837 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:06:27.188837 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:06:27.188837 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:06:27.188837 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:06:27.190310 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:06:27.190310 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 13:06:27.190310 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 13:06:27.190310 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 13:06:27.190310 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 13:06:27.190310 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 13:06:27.190310 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 13:06:27.190310 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e could not be found. Aug 31 13:06:27.190310 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:06:27.190310 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:06:27.190310 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:06:27.190310 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:06:27.190310 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:06:27.190310 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:06:27.190310 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:06:27.190310 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:06:27.190310 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e could not be found. Aug 31 13:06:27.190310 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:06:27.191589 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-0f2aa2ee-9cd7-4620-a17a-8d4fd58f4d18 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Returning 404 to user: Instance ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e could not be found. {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:06:27.191589 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-0f2aa2ee-9cd7-4620-a17a-8d4fd58f4d18 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e" status: 404 len: 111 microversion: 2.1 time: 0.033797 Aug 31 13:06:27.191589 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 315/646] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:06:27 2022] GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:06:27.194150 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-c6f4e7e3-f845-418d-8ad1-4bb723671479 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '.version_select at 0x7f19512403a0>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:06:27.219783 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-c6f4e7e3-f845-418d-8ad1-4bb723671479 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-798286424" status: 202 len: 0 microversion: 2.1 time: 0.029855 Aug 31 13:06:27.220339 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 332/647] 10.222.0.58 () {58 vars in 1218 bytes} [Wed Aug 31 13:06:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-798286424 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:06:27.938045 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-a29534fb-b54c-437d-b2af-cb895ee3b0e1 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:06:27.938635 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-a29534fb-b54c-437d-b2af-cb895ee3b0e1 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ba62b7ce-5880-4281-a5a4-020d70e5b16d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:06:27.945347 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a29534fb-b54c-437d-b2af-cb895ee3b0e1 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:27.945868 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a29534fb-b54c-437d-b2af-cb895ee3b0e1 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:27.946300 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a29534fb-b54c-437d-b2af-cb895ee3b0e1 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:27.947055 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a29534fb-b54c-437d-b2af-cb895ee3b0e1 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:27.947499 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a29534fb-b54c-437d-b2af-cb895ee3b0e1 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:27.947946 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a29534fb-b54c-437d-b2af-cb895ee3b0e1 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:28.034582 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.objects.instance [None req-a29534fb-b54c-437d-b2af-cb895ee3b0e1 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lazy-loading 'services' on Instance uuid ba62b7ce-5880-4281-a5a4-020d70e5b16d {{(pid=120705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 13:06:28.114824 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-a29534fb-b54c-437d-b2af-cb895ee3b0e1 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d/os-volume_attachments/8680ae01-8489-42f5-b63f-622cda4dcf14" status: 202 len: 0 microversion: 2.1 time: 0.180741 Aug 31 13:06:28.115524 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 316/648] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 31 13:06:27 2022] DELETE /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d/os-volume_attachments/8680ae01-8489-42f5-b63f-622cda4dcf14 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:06:28.124171 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-cfde76cb-2e35-4aca-a13d-11abd9a03108 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:06:28.126509 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-cfde76cb-2e35-4aca-a13d-11abd9a03108 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ba62b7ce-5880-4281-a5a4-020d70e5b16d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:06:28.133376 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cfde76cb-2e35-4aca-a13d-11abd9a03108 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:28.133939 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cfde76cb-2e35-4aca-a13d-11abd9a03108 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:28.134430 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cfde76cb-2e35-4aca-a13d-11abd9a03108 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:28.135193 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cfde76cb-2e35-4aca-a13d-11abd9a03108 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:28.135733 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cfde76cb-2e35-4aca-a13d-11abd9a03108 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:28.136184 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cfde76cb-2e35-4aca-a13d-11abd9a03108 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:28.166772 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-cfde76cb-2e35-4aca-a13d-11abd9a03108 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046673 Aug 31 13:06:28.167310 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 333/649] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 31 13:06:28 2022] GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:06:29.181954 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-56e412d3-8b3b-461f-b6ab-2cca753d673c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:06:29.184217 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-56e412d3-8b3b-461f-b6ab-2cca753d673c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ba62b7ce-5880-4281-a5a4-020d70e5b16d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:06:29.191498 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-56e412d3-8b3b-461f-b6ab-2cca753d673c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:29.192085 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-56e412d3-8b3b-461f-b6ab-2cca753d673c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:29.193187 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-56e412d3-8b3b-461f-b6ab-2cca753d673c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:29.193909 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-56e412d3-8b3b-461f-b6ab-2cca753d673c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:29.194358 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-56e412d3-8b3b-461f-b6ab-2cca753d673c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:29.194775 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-56e412d3-8b3b-461f-b6ab-2cca753d673c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:29.226808 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-56e412d3-8b3b-461f-b6ab-2cca753d673c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050923 Aug 31 13:06:29.227413 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 317/650] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 31 13:06:29 2022] GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:06:30.240600 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-78efe253-649f-41cd-8677-8689c17dab00 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:06:30.242687 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-78efe253-649f-41cd-8677-8689c17dab00 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ba62b7ce-5880-4281-a5a4-020d70e5b16d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:06:30.249519 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-78efe253-649f-41cd-8677-8689c17dab00 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:30.249997 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-78efe253-649f-41cd-8677-8689c17dab00 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:30.250423 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-78efe253-649f-41cd-8677-8689c17dab00 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:30.251103 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-78efe253-649f-41cd-8677-8689c17dab00 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:30.251548 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-78efe253-649f-41cd-8677-8689c17dab00 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:30.251998 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-78efe253-649f-41cd-8677-8689c17dab00 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:30.281936 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-78efe253-649f-41cd-8677-8689c17dab00 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045888 Aug 31 13:06:30.282812 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 334/651] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 31 13:06:30 2022] GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 13:06:30.356435 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e0334bf1-bef2-417c-95d5-fbab0d3755a1 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:06:30.356991 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e0334bf1-bef2-417c-95d5-fbab0d3755a1 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ba62b7ce-5880-4281-a5a4-020d70e5b16d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:06:30.363913 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e0334bf1-bef2-417c-95d5-fbab0d3755a1 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:30.364372 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e0334bf1-bef2-417c-95d5-fbab0d3755a1 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:30.364830 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e0334bf1-bef2-417c-95d5-fbab0d3755a1 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:30.365519 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e0334bf1-bef2-417c-95d5-fbab0d3755a1 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:30.365967 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e0334bf1-bef2-417c-95d5-fbab0d3755a1 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:30.366387 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e0334bf1-bef2-417c-95d5-fbab0d3755a1 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:30.391701 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e0334bf1-bef2-417c-95d5-fbab0d3755a1 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ba62b7ce-5880-4281-a5a4-020d70e5b16d] Going to try to terminate instance {{(pid=120705) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 13:06:30.484613 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e0334bf1-bef2-417c-95d5-fbab0d3755a1 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d" status: 204 len: 0 microversion: 2.1 time: 0.131774 Aug 31 13:06:30.485327 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 318/652] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 31 13:06:30 2022] DELETE /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:06:30.493919 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-9245d0a2-1e98-4e00-b635-96fd181604df tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:06:30.494463 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-9245d0a2-1e98-4e00-b635-96fd181604df tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ba62b7ce-5880-4281-a5a4-020d70e5b16d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:06:30.500635 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9245d0a2-1e98-4e00-b635-96fd181604df tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:30.501179 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9245d0a2-1e98-4e00-b635-96fd181604df tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:30.501592 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9245d0a2-1e98-4e00-b635-96fd181604df tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:30.502267 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9245d0a2-1e98-4e00-b635-96fd181604df tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:30.502713 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9245d0a2-1e98-4e00-b635-96fd181604df tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:30.503157 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9245d0a2-1e98-4e00-b635-96fd181604df tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:30.646994 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-9245d0a2-1e98-4e00-b635-96fd181604df tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:06:30.655269 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-9245d0a2-1e98-4e00-b635-96fd181604df tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d" status: 200 len: 1681 microversion: 2.1 time: 0.165216 Aug 31 13:06:30.655858 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 335/653] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:06:30 2022] GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:06:31.680187 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b81d8ebb-64c8-4950-8cbd-20bdbc7e4acf tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:06:31.681093 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b81d8ebb-64c8-4950-8cbd-20bdbc7e4acf tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ba62b7ce-5880-4281-a5a4-020d70e5b16d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:06:31.690027 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b81d8ebb-64c8-4950-8cbd-20bdbc7e4acf tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:31.690754 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b81d8ebb-64c8-4950-8cbd-20bdbc7e4acf tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:31.691205 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b81d8ebb-64c8-4950-8cbd-20bdbc7e4acf tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:31.691918 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b81d8ebb-64c8-4950-8cbd-20bdbc7e4acf tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:31.692363 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b81d8ebb-64c8-4950-8cbd-20bdbc7e4acf tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:31.692778 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b81d8ebb-64c8-4950-8cbd-20bdbc7e4acf tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:31.829003 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-b81d8ebb-64c8-4950-8cbd-20bdbc7e4acf tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:06:31.837822 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b81d8ebb-64c8-4950-8cbd-20bdbc7e4acf tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d" status: 200 len: 1681 microversion: 2.1 time: 0.163323 Aug 31 13:06:31.838456 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 319/654] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:06:31 2022] GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:06:32.581332 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-8f19c783-ed16-4ef3-bc56-9673452c6803 req-7722b694-d5e5-4308-afe9-6e741f5239a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba62b7ce-5880-4281-a5a4-020d70e5b16d", "name": "network-vif-deleted", "tag": "aa4db9c7-a72c-4448-8fdd-44507dfa381d"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:06:32.594296 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-8f19c783-ed16-4ef3-bc56-9673452c6803 req-7722b694-d5e5-4308-afe9-6e741f5239a7 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:32.594770 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-8f19c783-ed16-4ef3-bc56-9673452c6803 req-7722b694-d5e5-4308-afe9-6e741f5239a7 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:32.595184 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-8f19c783-ed16-4ef3-bc56-9673452c6803 req-7722b694-d5e5-4308-afe9-6e741f5239a7 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:32.608434 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-8f19c783-ed16-4ef3-bc56-9673452c6803 req-7722b694-d5e5-4308-afe9-6e741f5239a7 service nova] Creating event network-vif-deleted:aa4db9c7-a72c-4448-8fdd-44507dfa381d for instance ba62b7ce-5880-4281-a5a4-020d70e5b16d on hv-cinder-85442 Aug 31 13:06:32.613684 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-8f19c783-ed16-4ef3-bc56-9673452c6803 req-7722b694-d5e5-4308-afe9-6e741f5239a7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035984 Aug 31 13:06:32.614354 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 336/655] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:06:32.861007 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-bdd998f8-4020-4915-aed7-dfba56a09a87 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:06:32.861871 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-bdd998f8-4020-4915-aed7-dfba56a09a87 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ba62b7ce-5880-4281-a5a4-020d70e5b16d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:06:32.870163 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bdd998f8-4020-4915-aed7-dfba56a09a87 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:32.870885 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bdd998f8-4020-4915-aed7-dfba56a09a87 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:32.871407 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bdd998f8-4020-4915-aed7-dfba56a09a87 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:32.872235 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bdd998f8-4020-4915-aed7-dfba56a09a87 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:32.872738 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bdd998f8-4020-4915-aed7-dfba56a09a87 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:32.873284 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bdd998f8-4020-4915-aed7-dfba56a09a87 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:32.906704 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bdd998f8-4020-4915-aed7-dfba56a09a87 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:32.907493 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bdd998f8-4020-4915-aed7-dfba56a09a87 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:32.907961 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bdd998f8-4020-4915-aed7-dfba56a09a87 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:32.908429 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.objects.instance [None req-bdd998f8-4020-4915-aed7-dfba56a09a87 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lazy-loading 'fault' on Instance uuid ba62b7ce-5880-4281-a5a4-020d70e5b16d {{(pid=120705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 13:06:32.950103 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-bdd998f8-4020-4915-aed7-dfba56a09a87 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:06:32.959022 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-bdd998f8-4020-4915-aed7-dfba56a09a87 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d" status: 200 len: 1331 microversion: 2.1 time: 0.102842 Aug 31 13:06:32.959778 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 320/656] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:06:32 2022] GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d => generated 1331 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:06:33.983980 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-61f60db8-d12a-4426-9f49-fbebd95f8fd7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:06:33.984769 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-61f60db8-d12a-4426-9f49-fbebd95f8fd7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ba62b7ce-5880-4281-a5a4-020d70e5b16d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:06:33.992688 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-61f60db8-d12a-4426-9f49-fbebd95f8fd7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:33.993160 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-61f60db8-d12a-4426-9f49-fbebd95f8fd7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:33.993589 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-61f60db8-d12a-4426-9f49-fbebd95f8fd7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:33.994269 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-61f60db8-d12a-4426-9f49-fbebd95f8fd7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:33.994732 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-61f60db8-d12a-4426-9f49-fbebd95f8fd7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:33.995125 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-61f60db8-d12a-4426-9f49-fbebd95f8fd7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:34.009401 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.wsgi [None req-61f60db8-d12a-4426-9f49-fbebd95f8fd7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] HTTP exception thrown: Instance ba62b7ce-5880-4281-a5a4-020d70e5b16d could not be found. Aug 31 13:06:34.011017 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-61f60db8-d12a-4426-9f49-fbebd95f8fd7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Request method failure captured: Aug 31 13:06:34.011017 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: request: GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d HTTP/1.1 Aug 31 13:06:34.011017 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept: application/json Aug 31 13:06:34.011017 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept-Encoding: identity Aug 31 13:06:34.011017 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Connection: close Aug 31 13:06:34.011017 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Length: 0 Aug 31 13:06:34.011017 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Type: application/json Aug 31 13:06:34.011017 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Host: 10.222.0.58 Aug 31 13:06:34.011017 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Openstack-System-Scope: None Aug 31 13:06:34.011017 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: User-Agent: python-urllib3/1.26.12 Aug 31 13:06:34.011017 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Auth-Token: gAAAAABjD1uCNSnUQPMlQgFT2jq-eB19r7xLb94uzxGnoJXWTepSWTo7UQTZU86dPbIoFZ8qqdn2aU_O4yRfHOsmgtmeK9yuhxtC117CeRP8ROwyQq4z33BXiou8fAPjfT5vF29_iKZcD17NL5FwHgpz6cSqA2AiwZ_XLORdaExhfMVopvwp8pU Aug 31 13:06:34.011017 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Id: None Aug 31 13:06:34.011017 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Name: None Aug 31 13:06:34.011017 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Identity-Status: Confirmed Aug 31 13:06:34.011017 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Is-Admin-Project: True Aug 31 13:06:34.011017 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Id: default Aug 31 13:06:34.011017 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Name: Default Aug 31 13:06:34.011017 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Id: fdf85a7b31004baf848842ad2f74cbf0 Aug 31 13:06:34.011017 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Name: tempest-AttachVolumeNegativeTest-2039526226 Aug 31 13:06:34.011017 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Role: member,reader Aug 31 13:06:34.011017 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Roles: member,reader Aug 31 13:06:34.012563 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fdf85a7b31004baf848842ad2f74cbf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fdf85a7b31004baf848842ad2f74cbf0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fdf85a7b31004baf848842ad2f74cbf0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fdf85a7b31004baf848842ad2f74cbf0"}]}] Aug 31 13:06:34.012563 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant: tempest-AttachVolumeNegativeTest-2039526226 Aug 31 13:06:34.012563 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Id: fdf85a7b31004baf848842ad2f74cbf0 Aug 31 13:06:34.012563 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2039526226 Aug 31 13:06:34.012563 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User: tempest-AttachVolumeNegativeTest-2039526226-project Aug 31 13:06:34.012563 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Id: default Aug 31 13:06:34.012563 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Name: Default Aug 31 13:06:34.012563 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Id: ac2a50988be24e20be034777225d8106 Aug 31 13:06:34.012563 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Name: tempest-AttachVolumeNegativeTest-2039526226-project Aug 31 13:06:34.012563 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: method: > Aug 31 13:06:34.012563 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: exception: Instance ba62b7ce-5880-4281-a5a4-020d70e5b16d could not be found. Aug 31 13:06:34.012563 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: action_args: {'id': 'ba62b7ce-5880-4281-a5a4-020d70e5b16d'} Aug 31 13:06:34.013430 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:06:34.013430 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:06:34.013430 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 13:06:34.013430 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 13:06:34.013430 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 13:06:34.013430 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 13:06:34.013430 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 13:06:34.013430 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 13:06:34.013430 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 13:06:34.013430 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 13:06:34.013430 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba62b7ce-5880-4281-a5a4-020d70e5b16d could not be found. Aug 31 13:06:34.013430 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:06:34.013430 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:06:34.013430 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:06:34.013430 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:06:34.013430 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:06:34.013430 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:06:34.013430 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:06:34.013430 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:06:34.013430 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:06:34.014898 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:06:34.014898 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 13:06:34.014898 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 13:06:34.014898 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 13:06:34.014898 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 13:06:34.014898 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 13:06:34.014898 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 13:06:34.014898 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba62b7ce-5880-4281-a5a4-020d70e5b16d could not be found. Aug 31 13:06:34.014898 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:06:34.014898 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:06:34.014898 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:06:34.014898 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:06:34.014898 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:06:34.014898 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:06:34.014898 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:06:34.014898 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:06:34.014898 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba62b7ce-5880-4281-a5a4-020d70e5b16d could not be found. Aug 31 13:06:34.014898 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:06:34.016250 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-61f60db8-d12a-4426-9f49-fbebd95f8fd7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Returning 404 to user: Instance ba62b7ce-5880-4281-a5a4-020d70e5b16d could not be found. {{(pid=120704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:06:34.016250 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-61f60db8-d12a-4426-9f49-fbebd95f8fd7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d" status: 404 len: 111 microversion: 2.1 time: 0.034915 Aug 31 13:06:34.016250 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 337/657] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:06:33 2022] GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:06:34.022375 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-5843a19d-7c7f-4bb5-bcf7-5ceafa8be539 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '.version_select at 0x7f1951378670>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:06:34.048266 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-5843a19d-7c7f-4bb5-bcf7-5ceafa8be539 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2030730088" status: 202 len: 0 microversion: 2.1 time: 0.030020 Aug 31 13:06:34.049077 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 321/658] 10.222.0.58 () {58 vars in 1221 bytes} [Wed Aug 31 13:06:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2030730088 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:06:34.714947 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-8e5efd17-6edd-4e0b-82cc-bcf9ba6830d7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Action: 'create', calling method: .version_select at 0x7f195132baf0>, body: {"keypair": {"name": "tempest-keypair-317594431", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJaW01Gw8Zbh6jwtB7vy0jzvJxd5ks3Og1vWpFQc6Mu0jZw+cSpPwPW2wfeRes0Bs4cWeuAO534NVMq6EbXeSUyTUFtOIpLrnJoPwyImT+fLjGAvLAZ0BqT3egbzM9SaQ=="}} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:06:34.733865 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.quota [None req-8e5efd17-6edd-4e0b-82cc-bcf9ba6830d7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Getting quotas for project fdf85a7b31004baf848842ad2f74cbf0. Resources: {'key_pairs'} {{(pid=120704) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 13:06:34.737954 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.quota [None req-8e5efd17-6edd-4e0b-82cc-bcf9ba6830d7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Getting quotas for user ac2a50988be24e20be034777225d8106 and project fdf85a7b31004baf848842ad2f74cbf0. Resources: {'key_pairs'} {{(pid=120704) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 13:06:34.761219 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-8e5efd17-6edd-4e0b-82cc-bcf9ba6830d7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052184 Aug 31 13:06:34.761829 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 338/659] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 31 13:06:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:06:36.047303 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-9a68f69c-7dd9-4fe2-9762-1f6a2efa22d0 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-617270288", "imageRef": "2aa55919-0f25-4e84-a2e1-f60acbe208b2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fb3a8ad8-8a96-4988-83d8-367334d3fb95"}], "security_groups": [{"name": "tempest-securitygroup--1593071356"}], "key_name": "tempest-keypair-317594431", "user_data": "}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:06:36.164731 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.network.neutron [None req-9a68f69c-7dd9-4fe2-9762-1f6a2efa22d0 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] validate_networks() for [('fb3a8ad8-8a96-4988-83d8-367334d3fb95', None, None, None, None, None)] {{(pid=120705) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 13:06:36.553776 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-9a68f69c-7dd9-4fe2-9762-1f6a2efa22d0 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Flavor limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 13:06:36.554203 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-9a68f69c-7dd9-4fe2-9762-1f6a2efa22d0 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Image limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 13:06:36.554677 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-9a68f69c-7dd9-4fe2-9762-1f6a2efa22d0 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Flavor pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 13:06:36.555102 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-9a68f69c-7dd9-4fe2-9762-1f6a2efa22d0 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Image pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 13:06:36.555489 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-9a68f69c-7dd9-4fe2-9762-1f6a2efa22d0 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 13:06:36.565297 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9a68f69c-7dd9-4fe2-9762-1f6a2efa22d0 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:36.565811 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9a68f69c-7dd9-4fe2-9762-1f6a2efa22d0 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:36.566245 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9a68f69c-7dd9-4fe2-9762-1f6a2efa22d0 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:36.566968 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9a68f69c-7dd9-4fe2-9762-1f6a2efa22d0 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:36.567421 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9a68f69c-7dd9-4fe2-9762-1f6a2efa22d0 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:36.567849 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9a68f69c-7dd9-4fe2-9762-1f6a2efa22d0 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:36.585578 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-9a68f69c-7dd9-4fe2-9762-1f6a2efa22d0 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Getting quotas for project fdf85a7b31004baf848842ad2f74cbf0. Resources: {'instances', 'ram', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 13:06:36.589888 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-9a68f69c-7dd9-4fe2-9762-1f6a2efa22d0 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Getting quotas for user ac2a50988be24e20be034777225d8106 and project fdf85a7b31004baf848842ad2f74cbf0. Resources: {'instances', 'ram', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 13:06:36.601627 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-9a68f69c-7dd9-4fe2-9762-1f6a2efa22d0 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Going to run 1 instances... {{(pid=120705) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 13:06:36.603960 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-9a68f69c-7dd9-4fe2-9762-1f6a2efa22d0 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 57462145-0049-4cce-87cf-698a1ebbbee3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2aa55919-0f25-4e84-a2e1-f60acbe208b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120705) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 13:06:36.654771 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-9a68f69c-7dd9-4fe2-9762-1f6a2efa22d0 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.614981 Aug 31 13:06:36.655426 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 322/660] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 31 13:06:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 13:06:36.667291 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-d6504dad-d2b5-4b24-954e-76ce6d1d7489 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:06:36.667970 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-d6504dad-d2b5-4b24-954e-76ce6d1d7489 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 57462145-0049-4cce-87cf-698a1ebbbee3] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:06:36.722912 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-d6504dad-d2b5-4b24-954e-76ce6d1d7489 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:06:36.730759 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-d6504dad-d2b5-4b24-954e-76ce6d1d7489 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3" status: 200 len: 1240 microversion: 2.1 time: 0.067346 Aug 31 13:06:36.731141 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 339/661] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:06:36 2022] GET /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3 => generated 1240 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:06:37.756151 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-741ca8f2-4999-435b-9f0a-5ef6225f6aaa tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:06:37.756782 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-741ca8f2-4999-435b-9f0a-5ef6225f6aaa tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 57462145-0049-4cce-87cf-698a1ebbbee3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:06:37.767247 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-741ca8f2-4999-435b-9f0a-5ef6225f6aaa tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:37.767935 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-741ca8f2-4999-435b-9f0a-5ef6225f6aaa tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:37.768481 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-741ca8f2-4999-435b-9f0a-5ef6225f6aaa tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:37.769299 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-741ca8f2-4999-435b-9f0a-5ef6225f6aaa tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:37.769724 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-741ca8f2-4999-435b-9f0a-5ef6225f6aaa tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:37.770173 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-741ca8f2-4999-435b-9f0a-5ef6225f6aaa tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:37.836770 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-741ca8f2-4999-435b-9f0a-5ef6225f6aaa tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:06:37.848612 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-741ca8f2-4999-435b-9f0a-5ef6225f6aaa tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3" status: 200 len: 1292 microversion: 2.1 time: 0.099897 Aug 31 13:06:37.849384 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 323/662] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:06:37 2022] GET /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3 => generated 1292 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:06:38.873646 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-1bb33874-298d-410a-8c29-2d0ed5c01ebe tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:06:38.874213 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-1bb33874-298d-410a-8c29-2d0ed5c01ebe tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 57462145-0049-4cce-87cf-698a1ebbbee3] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:06:38.881190 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1bb33874-298d-410a-8c29-2d0ed5c01ebe tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:38.881667 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1bb33874-298d-410a-8c29-2d0ed5c01ebe tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:38.882102 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1bb33874-298d-410a-8c29-2d0ed5c01ebe tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:38.882793 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1bb33874-298d-410a-8c29-2d0ed5c01ebe tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:38.883237 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1bb33874-298d-410a-8c29-2d0ed5c01ebe tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:38.883660 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1bb33874-298d-410a-8c29-2d0ed5c01ebe tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:39.025953 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-1bb33874-298d-410a-8c29-2d0ed5c01ebe tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:06:39.034397 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-1bb33874-298d-410a-8c29-2d0ed5c01ebe tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3" status: 200 len: 1366 microversion: 2.1 time: 0.164646 Aug 31 13:06:39.034993 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 340/663] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:06:38 2022] GET /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:06:39.638133 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-a83372ab-8514-43cf-8559-669688e81bfe req-1ec4367c-3a5d-45bf-9a7f-f821f126f8e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57462145-0049-4cce-87cf-698a1ebbbee3", "tag": "62b64a92-6618-4376-a7cb-adbe0fba009a"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:06:39.648339 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-a83372ab-8514-43cf-8559-669688e81bfe req-1ec4367c-3a5d-45bf-9a7f-f821f126f8e6 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:39.648827 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-a83372ab-8514-43cf-8559-669688e81bfe req-1ec4367c-3a5d-45bf-9a7f-f821f126f8e6 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:39.649238 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-a83372ab-8514-43cf-8559-669688e81bfe req-1ec4367c-3a5d-45bf-9a7f-f821f126f8e6 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:39.661120 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-a83372ab-8514-43cf-8559-669688e81bfe req-1ec4367c-3a5d-45bf-9a7f-f821f126f8e6 service nova] Creating event network-changed:62b64a92-6618-4376-a7cb-adbe0fba009a for instance 57462145-0049-4cce-87cf-698a1ebbbee3 on hv-cinder-85442 Aug 31 13:06:39.666186 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-a83372ab-8514-43cf-8559-669688e81bfe req-1ec4367c-3a5d-45bf-9a7f-f821f126f8e6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037147 Aug 31 13:06:39.666896 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 324/664] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:06:40.055120 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-86757715-f9b2-43f8-9815-22882f81d54a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:06:40.055682 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-86757715-f9b2-43f8-9815-22882f81d54a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 57462145-0049-4cce-87cf-698a1ebbbee3] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:06:40.065747 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-86757715-f9b2-43f8-9815-22882f81d54a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:40.066431 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-86757715-f9b2-43f8-9815-22882f81d54a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:40.066957 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-86757715-f9b2-43f8-9815-22882f81d54a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:40.067892 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-86757715-f9b2-43f8-9815-22882f81d54a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:40.068542 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-86757715-f9b2-43f8-9815-22882f81d54a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:40.069156 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-86757715-f9b2-43f8-9815-22882f81d54a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:40.200594 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-86757715-f9b2-43f8-9815-22882f81d54a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:06:40.209263 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-86757715-f9b2-43f8-9815-22882f81d54a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3" status: 200 len: 1366 microversion: 2.1 time: 0.158333 Aug 31 13:06:40.209892 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 341/665] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:06:40 2022] GET /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:06:41.235871 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-110a9508-2a5a-4d82-a950-bec4f69ea734 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:06:41.237176 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-110a9508-2a5a-4d82-a950-bec4f69ea734 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 57462145-0049-4cce-87cf-698a1ebbbee3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:06:41.247702 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-110a9508-2a5a-4d82-a950-bec4f69ea734 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:41.248555 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-110a9508-2a5a-4d82-a950-bec4f69ea734 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:41.249279 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-110a9508-2a5a-4d82-a950-bec4f69ea734 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:41.250565 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-110a9508-2a5a-4d82-a950-bec4f69ea734 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:41.251334 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-110a9508-2a5a-4d82-a950-bec4f69ea734 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:41.252081 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-110a9508-2a5a-4d82-a950-bec4f69ea734 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:41.394280 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-110a9508-2a5a-4d82-a950-bec4f69ea734 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:06:41.402340 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-110a9508-2a5a-4d82-a950-bec4f69ea734 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3" status: 200 len: 1366 microversion: 2.1 time: 0.174803 Aug 31 13:06:41.402914 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 325/666] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:06:41 2022] GET /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:06:42.426404 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-30d4edda-0178-432b-a265-196de38b30dc tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:06:42.426990 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-30d4edda-0178-432b-a265-196de38b30dc tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 57462145-0049-4cce-87cf-698a1ebbbee3] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:06:42.434102 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-30d4edda-0178-432b-a265-196de38b30dc tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:42.434580 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-30d4edda-0178-432b-a265-196de38b30dc tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:42.435004 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-30d4edda-0178-432b-a265-196de38b30dc tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:42.435725 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-30d4edda-0178-432b-a265-196de38b30dc tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:42.436205 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-30d4edda-0178-432b-a265-196de38b30dc tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:42.436608 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-30d4edda-0178-432b-a265-196de38b30dc tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:42.581353 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-30d4edda-0178-432b-a265-196de38b30dc tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:06:42.590059 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-30d4edda-0178-432b-a265-196de38b30dc tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3" status: 200 len: 1366 microversion: 2.1 time: 0.169544 Aug 31 13:06:42.590628 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 342/667] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:06:42 2022] GET /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:06:43.612486 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b3628f7a-b41b-4f72-a89b-2cbd342f5161 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:06:43.613136 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b3628f7a-b41b-4f72-a89b-2cbd342f5161 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 57462145-0049-4cce-87cf-698a1ebbbee3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:06:43.621723 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b3628f7a-b41b-4f72-a89b-2cbd342f5161 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:43.622251 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b3628f7a-b41b-4f72-a89b-2cbd342f5161 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:43.622778 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b3628f7a-b41b-4f72-a89b-2cbd342f5161 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:43.623586 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b3628f7a-b41b-4f72-a89b-2cbd342f5161 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:43.624142 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b3628f7a-b41b-4f72-a89b-2cbd342f5161 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:43.624643 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b3628f7a-b41b-4f72-a89b-2cbd342f5161 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:43.773433 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-b3628f7a-b41b-4f72-a89b-2cbd342f5161 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:06:43.786278 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b3628f7a-b41b-4f72-a89b-2cbd342f5161 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3" status: 200 len: 1366 microversion: 2.1 time: 0.178230 Aug 31 13:06:43.787242 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 326/668] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:06:43 2022] GET /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:06:44.810285 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-96bde1c9-d38d-422f-be85-206f56649c86 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:06:44.811103 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-96bde1c9-d38d-422f-be85-206f56649c86 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 57462145-0049-4cce-87cf-698a1ebbbee3] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:06:44.820855 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-96bde1c9-d38d-422f-be85-206f56649c86 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:44.821524 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-96bde1c9-d38d-422f-be85-206f56649c86 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:44.822084 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-96bde1c9-d38d-422f-be85-206f56649c86 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:44.823001 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-96bde1c9-d38d-422f-be85-206f56649c86 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:44.823614 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-96bde1c9-d38d-422f-be85-206f56649c86 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:44.824251 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-96bde1c9-d38d-422f-be85-206f56649c86 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:44.973308 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-96bde1c9-d38d-422f-be85-206f56649c86 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:06:44.981698 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-96bde1c9-d38d-422f-be85-206f56649c86 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3" status: 200 len: 1366 microversion: 2.1 time: 0.177571 Aug 31 13:06:44.982315 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 343/669] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:06:44 2022] GET /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:06:46.003047 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-8600d105-ba4b-46fd-ada0-196f3c200699 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:06:46.003664 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-8600d105-ba4b-46fd-ada0-196f3c200699 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 57462145-0049-4cce-87cf-698a1ebbbee3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:06:46.010599 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8600d105-ba4b-46fd-ada0-196f3c200699 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:46.011141 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8600d105-ba4b-46fd-ada0-196f3c200699 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:46.011564 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8600d105-ba4b-46fd-ada0-196f3c200699 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:46.012283 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8600d105-ba4b-46fd-ada0-196f3c200699 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:46.012725 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8600d105-ba4b-46fd-ada0-196f3c200699 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:46.013136 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8600d105-ba4b-46fd-ada0-196f3c200699 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:46.017216 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:46.165671 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-8600d105-ba4b-46fd-ada0-196f3c200699 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:06:46.176709 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-8600d105-ba4b-46fd-ada0-196f3c200699 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3" status: 200 len: 1366 microversion: 2.1 time: 0.177586 Aug 31 13:06:46.177277 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 327/670] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:06:45 2022] GET /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:06:46.593557 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-c06e0df8-e0c0-44b3-b643-98391d569af3 req-9d743343-ad80-4d53-96e3-9bf33d4212ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57462145-0049-4cce-87cf-698a1ebbbee3", "name": "network-vif-plugged", "status": "completed", "tag": "62b64a92-6618-4376-a7cb-adbe0fba009a"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:06:46.604566 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-c06e0df8-e0c0-44b3-b643-98391d569af3 req-9d743343-ad80-4d53-96e3-9bf33d4212ea service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:46.605126 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-c06e0df8-e0c0-44b3-b643-98391d569af3 req-9d743343-ad80-4d53-96e3-9bf33d4212ea service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:46.605553 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-c06e0df8-e0c0-44b3-b643-98391d569af3 req-9d743343-ad80-4d53-96e3-9bf33d4212ea service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:46.617160 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-c06e0df8-e0c0-44b3-b643-98391d569af3 req-9d743343-ad80-4d53-96e3-9bf33d4212ea service nova] Creating event network-vif-plugged:62b64a92-6618-4376-a7cb-adbe0fba009a for instance 57462145-0049-4cce-87cf-698a1ebbbee3 on hv-cinder-85442 Aug 31 13:06:46.623041 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-c06e0df8-e0c0-44b3-b643-98391d569af3 req-9d743343-ad80-4d53-96e3-9bf33d4212ea service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032884 Aug 31 13:06:46.623717 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 344/671] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:06:47.202266 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b79d2186-1132-4248-a166-91dd735457f7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:06:47.203371 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b79d2186-1132-4248-a166-91dd735457f7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 57462145-0049-4cce-87cf-698a1ebbbee3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:06:47.206514 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=2 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:47.207605 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=6 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:47.218547 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b79d2186-1132-4248-a166-91dd735457f7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:47.219336 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b79d2186-1132-4248-a166-91dd735457f7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:47.220112 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b79d2186-1132-4248-a166-91dd735457f7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:47.221244 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b79d2186-1132-4248-a166-91dd735457f7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:47.222005 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b79d2186-1132-4248-a166-91dd735457f7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:47.222427 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b79d2186-1132-4248-a166-91dd735457f7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:47.358967 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-b79d2186-1132-4248-a166-91dd735457f7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:06:47.367075 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b79d2186-1132-4248-a166-91dd735457f7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3" status: 200 len: 1366 microversion: 2.1 time: 0.171310 Aug 31 13:06:47.367655 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 328/672] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:06:47 2022] GET /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:06:48.392871 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-dc470543-5a9e-48da-b6b7-accb425d3f1e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:06:48.393899 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-dc470543-5a9e-48da-b6b7-accb425d3f1e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 57462145-0049-4cce-87cf-698a1ebbbee3] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:06:48.395853 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell0:SELECT=6 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:06:48.402296 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-dc470543-5a9e-48da-b6b7-accb425d3f1e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:48.402763 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-dc470543-5a9e-48da-b6b7-accb425d3f1e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:48.403190 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-dc470543-5a9e-48da-b6b7-accb425d3f1e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:48.403885 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-dc470543-5a9e-48da-b6b7-accb425d3f1e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:48.404328 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-dc470543-5a9e-48da-b6b7-accb425d3f1e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:48.404736 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-dc470543-5a9e-48da-b6b7-accb425d3f1e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:48.539511 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-dc470543-5a9e-48da-b6b7-accb425d3f1e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:06:48.550825 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-dc470543-5a9e-48da-b6b7-accb425d3f1e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3" status: 200 len: 1366 microversion: 2.1 time: 0.165044 Aug 31 13:06:48.551449 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 345/673] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:06:48 2022] GET /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:06:49.575921 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-9fc993e7-f9ef-46fe-9953-2f5a8c1eafc7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:06:49.576936 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-9fc993e7-f9ef-46fe-9953-2f5a8c1eafc7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 57462145-0049-4cce-87cf-698a1ebbbee3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:06:49.587991 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9fc993e7-f9ef-46fe-9953-2f5a8c1eafc7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:49.588837 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9fc993e7-f9ef-46fe-9953-2f5a8c1eafc7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:49.589581 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9fc993e7-f9ef-46fe-9953-2f5a8c1eafc7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:49.590686 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9fc993e7-f9ef-46fe-9953-2f5a8c1eafc7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:49.591433 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9fc993e7-f9ef-46fe-9953-2f5a8c1eafc7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:49.592205 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9fc993e7-f9ef-46fe-9953-2f5a8c1eafc7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:49.736517 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-9fc993e7-f9ef-46fe-9953-2f5a8c1eafc7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:06:49.744663 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-9fc993e7-f9ef-46fe-9953-2f5a8c1eafc7 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3" status: 200 len: 1556 microversion: 2.1 time: 0.175317 Aug 31 13:06:49.745218 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 329/674] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:06:49 2022] GET /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3 => generated 1556 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:06:49.764892 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-a7355532-fe3f-4565-9499-7a740225dd3a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:06:49.765423 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-a7355532-fe3f-4565-9499-7a740225dd3a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 57462145-0049-4cce-87cf-698a1ebbbee3] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:06:49.772384 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a7355532-fe3f-4565-9499-7a740225dd3a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:49.772859 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a7355532-fe3f-4565-9499-7a740225dd3a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:49.773292 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a7355532-fe3f-4565-9499-7a740225dd3a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:49.773973 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a7355532-fe3f-4565-9499-7a740225dd3a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:49.774424 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a7355532-fe3f-4565-9499-7a740225dd3a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:49.774843 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a7355532-fe3f-4565-9499-7a740225dd3a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:49.854906 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-a7355532-fe3f-4565-9499-7a740225dd3a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093503 Aug 31 13:06:49.855775 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 346/675] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 31 13:06:49 2022] GET /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:06:51.036364 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-7dab0bb5-f17e-4de5-937b-ef1d6f5a48bb req-32b60643-14bc-4016-a0cd-ed7e7cce02a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57462145-0049-4cce-87cf-698a1ebbbee3", "tag": "62b64a92-6618-4376-a7cb-adbe0fba009a"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:06:51.046908 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-7dab0bb5-f17e-4de5-937b-ef1d6f5a48bb req-32b60643-14bc-4016-a0cd-ed7e7cce02a1 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:06:51.047359 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-7dab0bb5-f17e-4de5-937b-ef1d6f5a48bb req-32b60643-14bc-4016-a0cd-ed7e7cce02a1 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:06:51.047856 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-7dab0bb5-f17e-4de5-937b-ef1d6f5a48bb req-32b60643-14bc-4016-a0cd-ed7e7cce02a1 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:06:51.058818 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-7dab0bb5-f17e-4de5-937b-ef1d6f5a48bb req-32b60643-14bc-4016-a0cd-ed7e7cce02a1 service nova] Creating event network-changed:62b64a92-6618-4376-a7cb-adbe0fba009a for instance 57462145-0049-4cce-87cf-698a1ebbbee3 on hv-cinder-85442 Aug 31 13:06:51.065238 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-7dab0bb5-f17e-4de5-937b-ef1d6f5a48bb req-32b60643-14bc-4016-a0cd-ed7e7cce02a1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031899 Aug 31 13:06:51.065238 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 330/676] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:07:01.412154 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:01.412900 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell1:SELECT=84 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:01.416892 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-cca87abf-eafc-4ee1-aa4d-bda023523a8e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:01.419031 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-cca87abf-eafc-4ee1-aa4d-bda023523a8e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:01.426434 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cca87abf-eafc-4ee1-aa4d-bda023523a8e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:01.426928 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cca87abf-eafc-4ee1-aa4d-bda023523a8e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:01.427341 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cca87abf-eafc-4ee1-aa4d-bda023523a8e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:01.428061 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cca87abf-eafc-4ee1-aa4d-bda023523a8e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:01.428507 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cca87abf-eafc-4ee1-aa4d-bda023523a8e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:01.428922 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cca87abf-eafc-4ee1-aa4d-bda023523a8e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:01.463180 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-cca87abf-eafc-4ee1-aa4d-bda023523a8e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051674 Aug 31 13:07:01.464098 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 347/677] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 31 13:07:01 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 13:07:01.529070 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-bbe8c08b-efed-4e43-879a-cdf3ad0eade7 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:01.529741 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-bbe8c08b-efed-4e43-879a-cdf3ad0eade7 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:01.533880 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:01.534568 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=18 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:01.540708 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bbe8c08b-efed-4e43-879a-cdf3ad0eade7 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:01.541188 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bbe8c08b-efed-4e43-879a-cdf3ad0eade7 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:01.541625 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bbe8c08b-efed-4e43-879a-cdf3ad0eade7 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:01.542315 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bbe8c08b-efed-4e43-879a-cdf3ad0eade7 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:01.542767 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bbe8c08b-efed-4e43-879a-cdf3ad0eade7 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:01.543188 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bbe8c08b-efed-4e43-879a-cdf3ad0eade7 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:01.570479 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-bbe8c08b-efed-4e43-879a-cdf3ad0eade7 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Going to try to terminate instance {{(pid=120705) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 13:07:01.653512 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-bbe8c08b-efed-4e43-879a-cdf3ad0eade7 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "DELETE /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 204 len: 0 microversion: 2.1 time: 0.131192 Aug 31 13:07:01.654107 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 331/678] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 31 13:07:01 2022] DELETE /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:07:01.663487 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-228e2a69-aa54-4aba-a2b6-5b96d77f9b59 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:01.664220 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-228e2a69-aa54-4aba-a2b6-5b96d77f9b59 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:01.671339 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-228e2a69-aa54-4aba-a2b6-5b96d77f9b59 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:01.671995 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-228e2a69-aa54-4aba-a2b6-5b96d77f9b59 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:01.672283 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-228e2a69-aa54-4aba-a2b6-5b96d77f9b59 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:01.672975 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-228e2a69-aa54-4aba-a2b6-5b96d77f9b59 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:01.673425 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-228e2a69-aa54-4aba-a2b6-5b96d77f9b59 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:01.673841 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-228e2a69-aa54-4aba-a2b6-5b96d77f9b59 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:01.801803 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-228e2a69-aa54-4aba-a2b6-5b96d77f9b59 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:01.810511 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-228e2a69-aa54-4aba-a2b6-5b96d77f9b59 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1674 microversion: 2.1 time: 0.151468 Aug 31 13:07:01.811073 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 348/679] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:07:01 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:07:02.837004 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-0afd3ff4-b05e-4f09-9259-4f960b370200 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:02.838177 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-0afd3ff4-b05e-4f09-9259-4f960b370200 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:02.849012 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0afd3ff4-b05e-4f09-9259-4f960b370200 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:02.849866 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0afd3ff4-b05e-4f09-9259-4f960b370200 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:02.850626 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0afd3ff4-b05e-4f09-9259-4f960b370200 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:02.851773 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0afd3ff4-b05e-4f09-9259-4f960b370200 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:02.852579 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0afd3ff4-b05e-4f09-9259-4f960b370200 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:02.853288 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0afd3ff4-b05e-4f09-9259-4f960b370200 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:02.998816 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-0afd3ff4-b05e-4f09-9259-4f960b370200 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:03.006845 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-0afd3ff4-b05e-4f09-9259-4f960b370200 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1674 microversion: 2.1 time: 0.177120 Aug 31 13:07:03.007451 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 332/680] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:07:02 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1674 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:07:04.028345 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-6687654b-1667-41bc-8b29-77ca718beef3 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:04.028929 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-6687654b-1667-41bc-8b29-77ca718beef3 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:04.037622 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6687654b-1667-41bc-8b29-77ca718beef3 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:04.038138 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6687654b-1667-41bc-8b29-77ca718beef3 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:04.038593 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6687654b-1667-41bc-8b29-77ca718beef3 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:04.039267 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6687654b-1667-41bc-8b29-77ca718beef3 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:04.039748 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6687654b-1667-41bc-8b29-77ca718beef3 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:04.040281 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6687654b-1667-41bc-8b29-77ca718beef3 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:04.102610 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-6687654b-1667-41bc-8b29-77ca718beef3 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:04.114583 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-6687654b-1667-41bc-8b29-77ca718beef3 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1607 microversion: 2.1 time: 0.090250 Aug 31 13:07:04.115463 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 349/681] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:07:04 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1607 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:07:04.233101 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-02fec4e4-dd62-4649-b593-d685350af675 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:04.233566 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-02fec4e4-dd62-4649-b593-d685350af675 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:04.240105 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-02fec4e4-dd62-4649-b593-d685350af675 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:04.240556 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-02fec4e4-dd62-4649-b593-d685350af675 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:04.241211 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-02fec4e4-dd62-4649-b593-d685350af675 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:04.241908 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-02fec4e4-dd62-4649-b593-d685350af675 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:04.242355 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-02fec4e4-dd62-4649-b593-d685350af675 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:04.242774 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-02fec4e4-dd62-4649-b593-d685350af675 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:04.292440 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-5dabea61-2e61-42ce-b528-aa9d23bd6ccc req-a7cfec81-8e39-43a0-b7cf-2fa6a1d18b87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48f08cc0-15cb-4884-960b-a96396a0d4bf", "name": "network-vif-deleted", "tag": "d7daad8a-fae2-4a08-ba82-bc48fa334e9e"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:07:04.302147 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-5dabea61-2e61-42ce-b528-aa9d23bd6ccc req-a7cfec81-8e39-43a0-b7cf-2fa6a1d18b87 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:04.302611 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-5dabea61-2e61-42ce-b528-aa9d23bd6ccc req-a7cfec81-8e39-43a0-b7cf-2fa6a1d18b87 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:04.303258 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-5dabea61-2e61-42ce-b528-aa9d23bd6ccc req-a7cfec81-8e39-43a0-b7cf-2fa6a1d18b87 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:04.315113 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-5dabea61-2e61-42ce-b528-aa9d23bd6ccc req-a7cfec81-8e39-43a0-b7cf-2fa6a1d18b87 service nova] Creating event network-vif-deleted:d7daad8a-fae2-4a08-ba82-bc48fa334e9e for instance 48f08cc0-15cb-4884-960b-a96396a0d4bf on hv-cinder-85442 Aug 31 13:07:04.326852 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-5dabea61-2e61-42ce-b528-aa9d23bd6ccc req-a7cfec81-8e39-43a0-b7cf-2fa6a1d18b87 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037475 Aug 31 13:07:04.336224 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.objects.instance [None req-02fec4e4-dd62-4649-b593-d685350af675 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lazy-loading 'services' on Instance uuid dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec {{(pid=120705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 13:07:04.336677 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 350/682] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:07:04.422340 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-02fec4e4-dd62-4649-b593-d685350af675 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "DELETE /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec/os-volume_attachments/b06416ea-a4ec-4677-a342-64ed4bd5df00" status: 202 len: 0 microversion: 2.1 time: 0.193333 Aug 31 13:07:04.427118 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 333/683] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 31 13:07:04 2022] DELETE /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec/os-volume_attachments/b06416ea-a4ec-4677-a342-64ed4bd5df00 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:07:04.433171 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-a9702b33-d12f-4d83-a4a6-4f7033c4a0d2 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:04.436284 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-a9702b33-d12f-4d83-a4a6-4f7033c4a0d2 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:04.443408 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a9702b33-d12f-4d83-a4a6-4f7033c4a0d2 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:04.444125 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a9702b33-d12f-4d83-a4a6-4f7033c4a0d2 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:04.444835 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a9702b33-d12f-4d83-a4a6-4f7033c4a0d2 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:04.445671 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a9702b33-d12f-4d83-a4a6-4f7033c4a0d2 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:04.446203 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a9702b33-d12f-4d83-a4a6-4f7033c4a0d2 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:04.446621 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a9702b33-d12f-4d83-a4a6-4f7033c4a0d2 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:04.483065 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-a9702b33-d12f-4d83-a4a6-4f7033c4a0d2 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055039 Aug 31 13:07:04.484034 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 351/684] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 31 13:07:04 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:07:05.139582 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-00d622fc-d441-4bda-a393-a3bff0721b85 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:05.140674 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-00d622fc-d441-4bda-a393-a3bff0721b85 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:05.151853 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-00d622fc-d441-4bda-a393-a3bff0721b85 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:05.152661 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-00d622fc-d441-4bda-a393-a3bff0721b85 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:05.153356 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-00d622fc-d441-4bda-a393-a3bff0721b85 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:05.154049 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-00d622fc-d441-4bda-a393-a3bff0721b85 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:05.154483 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-00d622fc-d441-4bda-a393-a3bff0721b85 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:05.154905 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-00d622fc-d441-4bda-a393-a3bff0721b85 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:05.191676 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-00d622fc-d441-4bda-a393-a3bff0721b85 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:05.192192 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-00d622fc-d441-4bda-a393-a3bff0721b85 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:05.192625 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-00d622fc-d441-4bda-a393-a3bff0721b85 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:05.193068 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.objects.instance [None req-00d622fc-d441-4bda-a393-a3bff0721b85 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lazy-loading 'fault' on Instance uuid 48f08cc0-15cb-4884-960b-a96396a0d4bf {{(pid=120705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 13:07:05.234498 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-00d622fc-d441-4bda-a393-a3bff0721b85 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:05.242351 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-00d622fc-d441-4bda-a393-a3bff0721b85 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 200 len: 1328 microversion: 2.1 time: 0.109581 Aug 31 13:07:05.243241 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 334/685] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:07:05 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 1328 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:07:05.496892 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-01a4cbe0-fcfe-4599-af11-c3f0b5bd57e3 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:05.499058 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-01a4cbe0-fcfe-4599-af11-c3f0b5bd57e3 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:05.505862 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-01a4cbe0-fcfe-4599-af11-c3f0b5bd57e3 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:05.506345 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-01a4cbe0-fcfe-4599-af11-c3f0b5bd57e3 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:05.506774 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-01a4cbe0-fcfe-4599-af11-c3f0b5bd57e3 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:05.507459 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-01a4cbe0-fcfe-4599-af11-c3f0b5bd57e3 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:05.507947 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-01a4cbe0-fcfe-4599-af11-c3f0b5bd57e3 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:05.508372 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-01a4cbe0-fcfe-4599-af11-c3f0b5bd57e3 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:05.538414 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-01a4cbe0-fcfe-4599-af11-c3f0b5bd57e3 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045571 Aug 31 13:07:05.538982 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 352/686] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 31 13:07:05 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:07:06.268510 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-5814a4c0-f375-47bd-a386-0e0a5a3769d6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:06.269115 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-5814a4c0-f375-47bd-a386-0e0a5a3769d6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:06.276093 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5814a4c0-f375-47bd-a386-0e0a5a3769d6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:06.276570 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5814a4c0-f375-47bd-a386-0e0a5a3769d6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:06.277006 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5814a4c0-f375-47bd-a386-0e0a5a3769d6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:06.277694 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5814a4c0-f375-47bd-a386-0e0a5a3769d6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:06.278143 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5814a4c0-f375-47bd-a386-0e0a5a3769d6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:06.278559 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5814a4c0-f375-47bd-a386-0e0a5a3769d6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:06.292627 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-5814a4c0-f375-47bd-a386-0e0a5a3769d6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] HTTP exception thrown: Instance 48f08cc0-15cb-4884-960b-a96396a0d4bf could not be found. Aug 31 13:07:06.294240 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-5814a4c0-f375-47bd-a386-0e0a5a3769d6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Request method failure captured: Aug 31 13:07:06.294240 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: request: GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf HTTP/1.1 Aug 31 13:07:06.294240 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 31 13:07:06.294240 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 31 13:07:06.294240 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Connection: close Aug 31 13:07:06.294240 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 31 13:07:06.294240 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 31 13:07:06.294240 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Host: 10.222.0.58 Aug 31 13:07:06.294240 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 31 13:07:06.294240 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 31 13:07:06.294240 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjD1seB5V-6Thim3iLBWgY6MZJsNXtjUZevzsLJVZ2NIiotfWIMtCtM4e6lfRHB222sjqzTtrnMO5z2WuJJHzUrBuHBLZK48wTJdmWU766QD_VCAlvS0b0famMH1kFEYrnHSShDM2yU5Kn_FtAJqWs7GunEyKuLclhv9wwGfMN0wYYABk Aug 31 13:07:06.294240 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 31 13:07:06.294240 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 31 13:07:06.294240 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 31 13:07:06.294240 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 31 13:07:06.294240 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 31 13:07:06.294240 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 31 13:07:06.294240 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Id: 58fa7489cdff42fcb41727a407a110a4 Aug 31 13:07:06.294240 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-AttachVolumeTestJSON-865036811 Aug 31 13:07:06.294240 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Role: member,reader Aug 31 13:07:06.294240 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Roles: member,reader Aug 31 13:07:06.295833 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_58fa7489cdff42fcb41727a407a110a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/58fa7489cdff42fcb41727a407a110a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/58fa7489cdff42fcb41727a407a110a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/58fa7489cdff42fcb41727a407a110a4"}]}] Aug 31 13:07:06.295833 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-AttachVolumeTestJSON-865036811 Aug 31 13:07:06.295833 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant-Id: 58fa7489cdff42fcb41727a407a110a4 Aug 31 13:07:06.295833 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-AttachVolumeTestJSON-865036811 Aug 31 13:07:06.295833 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User: tempest-AttachVolumeTestJSON-865036811-project Aug 31 13:07:06.295833 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 31 13:07:06.295833 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 31 13:07:06.295833 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Id: 65b1d441346f482e9981b1fa4015ea63 Aug 31 13:07:06.295833 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-AttachVolumeTestJSON-865036811-project Aug 31 13:07:06.295833 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: method: > Aug 31 13:07:06.295833 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: exception: Instance 48f08cc0-15cb-4884-960b-a96396a0d4bf could not be found. Aug 31 13:07:06.295833 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: action_args: {'id': '48f08cc0-15cb-4884-960b-a96396a0d4bf'} Aug 31 13:07:06.296880 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:07:06.296880 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:07:06.296880 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 13:07:06.296880 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 13:07:06.296880 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 13:07:06.296880 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 13:07:06.296880 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 13:07:06.296880 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 13:07:06.296880 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 13:07:06.296880 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 13:07:06.296880 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48f08cc0-15cb-4884-960b-a96396a0d4bf could not be found. Aug 31 13:07:06.296880 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:07:06.296880 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:07:06.296880 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:07:06.296880 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:07:06.296880 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:07:06.296880 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:07:06.296880 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:07:06.296880 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:07:06.296880 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:07:06.298415 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:07:06.298415 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 13:07:06.298415 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 13:07:06.298415 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 13:07:06.298415 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 13:07:06.298415 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 13:07:06.298415 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 13:07:06.298415 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48f08cc0-15cb-4884-960b-a96396a0d4bf could not be found. Aug 31 13:07:06.298415 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:07:06.298415 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:07:06.298415 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:07:06.298415 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:07:06.298415 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:07:06.298415 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:07:06.298415 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:07:06.298415 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:07:06.298415 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48f08cc0-15cb-4884-960b-a96396a0d4bf could not be found. Aug 31 13:07:06.298415 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:07:06.299913 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-5814a4c0-f375-47bd-a386-0e0a5a3769d6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Returning 404 to user: Instance 48f08cc0-15cb-4884-960b-a96396a0d4bf could not be found. {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:07:06.299913 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-5814a4c0-f375-47bd-a386-0e0a5a3769d6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 404 len: 111 microversion: 2.1 time: 0.033731 Aug 31 13:07:06.299913 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 335/687] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:07:06 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:07:06.304964 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-6b7ae073-4528-4c9e-8e04-fb2e9aec4c89 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '.version_select at 0x7f195120d040>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:06.325841 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-6b7ae073-4528-4c9e-8e04-fb2e9aec4c89 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1036327267" status: 202 len: 0 microversion: 2.1 time: 0.024973 Aug 31 13:07:06.326358 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 353/688] 10.222.0.58 () {58 vars in 1221 bytes} [Wed Aug 31 13:07:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1036327267 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:07:06.551092 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-8353001b-5cee-40f9-b701-e9207ed681fe tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:06.553375 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-8353001b-5cee-40f9-b701-e9207ed681fe tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:06.559704 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8353001b-5cee-40f9-b701-e9207ed681fe tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:06.560224 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8353001b-5cee-40f9-b701-e9207ed681fe tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:06.560652 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8353001b-5cee-40f9-b701-e9207ed681fe tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:06.561345 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8353001b-5cee-40f9-b701-e9207ed681fe tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:06.561789 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8353001b-5cee-40f9-b701-e9207ed681fe tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:06.562246 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8353001b-5cee-40f9-b701-e9207ed681fe tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:06.592920 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-8353001b-5cee-40f9-b701-e9207ed681fe tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045968 Aug 31 13:07:06.593496 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 336/689] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 31 13:07:06 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 13:07:06.671434 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-df739238-63b4-45e8-8178-4542a2211f32 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:06.672035 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-df739238-63b4-45e8-8178-4542a2211f32 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:06.679134 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-df739238-63b4-45e8-8178-4542a2211f32 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:06.679621 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-df739238-63b4-45e8-8178-4542a2211f32 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:06.680052 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-df739238-63b4-45e8-8178-4542a2211f32 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:06.680892 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-df739238-63b4-45e8-8178-4542a2211f32 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:06.681168 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-df739238-63b4-45e8-8178-4542a2211f32 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:06.681701 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-df739238-63b4-45e8-8178-4542a2211f32 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:06.706340 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-df739238-63b4-45e8-8178-4542a2211f32 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Going to try to terminate instance {{(pid=120704) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 13:07:06.787499 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-df739238-63b4-45e8-8178-4542a2211f32 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "DELETE /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 204 len: 0 microversion: 2.1 time: 0.119538 Aug 31 13:07:06.788430 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 354/690] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 31 13:07:06 2022] DELETE /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:07:06.796156 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-fc0b56a6-3302-4fbe-a0b4-d0fcff2df750 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:06.796757 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-fc0b56a6-3302-4fbe-a0b4-d0fcff2df750 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:06.803410 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fc0b56a6-3302-4fbe-a0b4-d0fcff2df750 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:06.803921 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fc0b56a6-3302-4fbe-a0b4-d0fcff2df750 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:06.804544 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fc0b56a6-3302-4fbe-a0b4-d0fcff2df750 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:06.805304 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fc0b56a6-3302-4fbe-a0b4-d0fcff2df750 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:06.805751 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fc0b56a6-3302-4fbe-a0b4-d0fcff2df750 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:06.806161 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-fc0b56a6-3302-4fbe-a0b4-d0fcff2df750 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:06.934804 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-fc0b56a6-3302-4fbe-a0b4-d0fcff2df750 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:06.944303 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-fc0b56a6-3302-4fbe-a0b4-d0fcff2df750 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1688 microversion: 2.1 time: 0.151819 Aug 31 13:07:06.944894 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 337/691] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:07:06 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1688 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:07:06.985882 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-ffe8de15-50c2-4a68-858f-f428e19307f6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Action: 'create', calling method: .version_select at 0x7f19513a3d30>, body: {"keypair": {"name": "tempest-keypair-734555079", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB6YBRY6rSqLdvE3W06jehW/obHhWuA2Ox9baR+R9WkaMTb2ymVfnh1++q3/VKioUyra3ZR9z3Ye4hN4rOp1ifUlXWtPjE4MUHiUzcb4TqjOmJcrJVW/pxI/AW52Bfxhxg=="}} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:07:07.000781 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.quota [None req-ffe8de15-50c2-4a68-858f-f428e19307f6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Getting quotas for project 58fa7489cdff42fcb41727a407a110a4. Resources: {'key_pairs'} {{(pid=120704) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 13:07:07.004456 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.quota [None req-ffe8de15-50c2-4a68-858f-f428e19307f6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Getting quotas for user 65b1d441346f482e9981b1fa4015ea63 and project 58fa7489cdff42fcb41727a407a110a4. Resources: {'key_pairs'} {{(pid=120704) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 13:07:07.029362 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-ffe8de15-50c2-4a68-858f-f428e19307f6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047747 Aug 31 13:07:07.030073 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 355/692] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 31 13:07:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:07:07.965835 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-4ae0f0f1-dada-46b5-99fd-5b08ce2e3f12 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:07.966414 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-4ae0f0f1-dada-46b5-99fd-5b08ce2e3f12 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:07.973244 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4ae0f0f1-dada-46b5-99fd-5b08ce2e3f12 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:07.973731 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4ae0f0f1-dada-46b5-99fd-5b08ce2e3f12 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:07.974233 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4ae0f0f1-dada-46b5-99fd-5b08ce2e3f12 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:07.974923 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4ae0f0f1-dada-46b5-99fd-5b08ce2e3f12 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:07.975374 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4ae0f0f1-dada-46b5-99fd-5b08ce2e3f12 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:07.975794 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4ae0f0f1-dada-46b5-99fd-5b08ce2e3f12 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:08.197643 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-4ae0f0f1-dada-46b5-99fd-5b08ce2e3f12 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:08.205920 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-4ae0f0f1-dada-46b5-99fd-5b08ce2e3f12 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1688 microversion: 2.1 time: 0.244084 Aug 31 13:07:08.206675 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 338/693] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:07:07 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1688 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:07:08.434881 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-449a31cf-dfd5-4d63-bd36-cc4b40e8fd5f tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1802840906", "imageRef": "2aa55919-0f25-4e84-a2e1-f60acbe208b2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "05644ee5-e646-4d3c-975e-ff7be4b6494e"}], "security_groups": [{"name": "tempest-securitygroup--1550219696"}], "key_name": "tempest-keypair-734555079", "user_data": "}} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:07:08.542321 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.network.neutron [None req-449a31cf-dfd5-4d63-bd36-cc4b40e8fd5f tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] validate_networks() for [('05644ee5-e646-4d3c-975e-ff7be4b6494e', None, None, None, None, None)] {{(pid=120704) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 13:07:08.920616 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.virt.hardware [None req-449a31cf-dfd5-4d63-bd36-cc4b40e8fd5f tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Flavor limits 0:0:0 {{(pid=120704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 13:07:08.921026 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.virt.hardware [None req-449a31cf-dfd5-4d63-bd36-cc4b40e8fd5f tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Image limits 0:0:0 {{(pid=120704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 13:07:08.921560 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.virt.hardware [None req-449a31cf-dfd5-4d63-bd36-cc4b40e8fd5f tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Flavor pref 0:0:0 {{(pid=120704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 13:07:08.921953 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.virt.hardware [None req-449a31cf-dfd5-4d63-bd36-cc4b40e8fd5f tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Image pref 0:0:0 {{(pid=120704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 13:07:08.922673 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.virt.hardware [None req-449a31cf-dfd5-4d63-bd36-cc4b40e8fd5f tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 13:07:08.935416 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-449a31cf-dfd5-4d63-bd36-cc4b40e8fd5f tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:08.935922 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-449a31cf-dfd5-4d63-bd36-cc4b40e8fd5f tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:08.936348 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-449a31cf-dfd5-4d63-bd36-cc4b40e8fd5f tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:08.937063 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-449a31cf-dfd5-4d63-bd36-cc4b40e8fd5f tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:08.937504 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-449a31cf-dfd5-4d63-bd36-cc4b40e8fd5f tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:08.938069 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-449a31cf-dfd5-4d63-bd36-cc4b40e8fd5f tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:08.955777 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.quota [None req-449a31cf-dfd5-4d63-bd36-cc4b40e8fd5f tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Getting quotas for project 58fa7489cdff42fcb41727a407a110a4. Resources: {'instances', 'ram', 'cores'} {{(pid=120704) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 13:07:08.960173 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.quota [None req-449a31cf-dfd5-4d63-bd36-cc4b40e8fd5f tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Getting quotas for user 65b1d441346f482e9981b1fa4015ea63 and project 58fa7489cdff42fcb41727a407a110a4. Resources: {'instances', 'ram', 'cores'} {{(pid=120704) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 13:07:08.971893 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-449a31cf-dfd5-4d63-bd36-cc4b40e8fd5f tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Going to run 1 instances... {{(pid=120704) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 13:07:08.974254 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-449a31cf-dfd5-4d63-bd36-cc4b40e8fd5f tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 49803c3f-e096-4c19-a579-3224e6fe2809] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2aa55919-0f25-4e84-a2e1-f60acbe208b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120704) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 13:07:09.027023 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-449a31cf-dfd5-4d63-bd36-cc4b40e8fd5f tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.596576 Aug 31 13:07:09.027870 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 356/694] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 31 13:07:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 13:07:09.041089 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-ed542182-3eff-4e1d-bf31-4dc6e4c8add2 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:09.041697 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-ed542182-3eff-4e1d-bf31-4dc6e4c8add2 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 49803c3f-e096-4c19-a579-3224e6fe2809] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:09.095859 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-ed542182-3eff-4e1d-bf31-4dc6e4c8add2 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:09.102837 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-ed542182-3eff-4e1d-bf31-4dc6e4c8add2 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809" status: 200 len: 1237 microversion: 2.1 time: 0.065621 Aug 31 13:07:09.103388 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 339/695] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:07:09 2022] GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809 => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:07:09.227682 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-7eecb30d-f0e6-4907-89f2-294f62d8ce0f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:09.228311 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-7eecb30d-f0e6-4907-89f2-294f62d8ce0f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:09.235309 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7eecb30d-f0e6-4907-89f2-294f62d8ce0f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:09.235896 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7eecb30d-f0e6-4907-89f2-294f62d8ce0f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:09.236323 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7eecb30d-f0e6-4907-89f2-294f62d8ce0f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:09.237056 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7eecb30d-f0e6-4907-89f2-294f62d8ce0f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:09.237493 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7eecb30d-f0e6-4907-89f2-294f62d8ce0f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:09.237939 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7eecb30d-f0e6-4907-89f2-294f62d8ce0f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:09.369850 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-7eecb30d-f0e6-4907-89f2-294f62d8ce0f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:09.377789 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-7eecb30d-f0e6-4907-89f2-294f62d8ce0f tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1688 microversion: 2.1 time: 0.154264 Aug 31 13:07:09.378487 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 357/696] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:07:09 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:07:10.127243 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-81442596-2cdc-4fdc-9408-86b5a4417183 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:10.128177 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-81442596-2cdc-4fdc-9408-86b5a4417183 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 49803c3f-e096-4c19-a579-3224e6fe2809] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:10.139481 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-81442596-2cdc-4fdc-9408-86b5a4417183 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:10.140334 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-81442596-2cdc-4fdc-9408-86b5a4417183 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:10.141059 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-81442596-2cdc-4fdc-9408-86b5a4417183 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:10.142255 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-81442596-2cdc-4fdc-9408-86b5a4417183 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:10.143091 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-81442596-2cdc-4fdc-9408-86b5a4417183 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:10.143733 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-81442596-2cdc-4fdc-9408-86b5a4417183 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:10.210823 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-81442596-2cdc-4fdc-9408-86b5a4417183 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:10.223334 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-81442596-2cdc-4fdc-9408-86b5a4417183 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809" status: 200 len: 1241 microversion: 2.1 time: 0.101924 Aug 31 13:07:10.224141 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 340/697] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:07:10 2022] GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809 => generated 1241 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:07:10.404184 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-80a10f21-7842-49b4-8a8a-96551e91b317 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:10.405178 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-80a10f21-7842-49b4-8a8a-96551e91b317 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:10.413885 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-80a10f21-7842-49b4-8a8a-96551e91b317 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:10.414367 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-80a10f21-7842-49b4-8a8a-96551e91b317 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:10.414802 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-80a10f21-7842-49b4-8a8a-96551e91b317 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:10.415494 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-80a10f21-7842-49b4-8a8a-96551e91b317 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:10.415985 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-80a10f21-7842-49b4-8a8a-96551e91b317 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:10.416410 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-80a10f21-7842-49b4-8a8a-96551e91b317 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:10.547417 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-80a10f21-7842-49b4-8a8a-96551e91b317 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:10.555469 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-80a10f21-7842-49b4-8a8a-96551e91b317 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1688 microversion: 2.1 time: 0.157988 Aug 31 13:07:10.556088 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 358/698] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:07:10 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:07:11.249597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-1054e44a-27e2-486f-85dc-d25b52288b29 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:11.250206 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-1054e44a-27e2-486f-85dc-d25b52288b29 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 49803c3f-e096-4c19-a579-3224e6fe2809] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:11.257019 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1054e44a-27e2-486f-85dc-d25b52288b29 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:11.257488 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1054e44a-27e2-486f-85dc-d25b52288b29 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:11.257947 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1054e44a-27e2-486f-85dc-d25b52288b29 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:11.258630 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1054e44a-27e2-486f-85dc-d25b52288b29 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:11.259067 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1054e44a-27e2-486f-85dc-d25b52288b29 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:11.259472 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1054e44a-27e2-486f-85dc-d25b52288b29 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:11.322585 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-1054e44a-27e2-486f-85dc-d25b52288b29 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:11.330465 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-1054e44a-27e2-486f-85dc-d25b52288b29 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809" status: 200 len: 1289 microversion: 2.1 time: 0.085163 Aug 31 13:07:11.331276 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 341/699] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:07:11 2022] GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809 => generated 1289 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:07:11.580264 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-dd6265f2-b45e-4761-b7bf-55d38d397860 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:11.580992 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-dd6265f2-b45e-4761-b7bf-55d38d397860 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:11.588648 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-dd6265f2-b45e-4761-b7bf-55d38d397860 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:11.589124 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-dd6265f2-b45e-4761-b7bf-55d38d397860 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:11.589552 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-dd6265f2-b45e-4761-b7bf-55d38d397860 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:11.590250 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-dd6265f2-b45e-4761-b7bf-55d38d397860 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:11.590695 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-dd6265f2-b45e-4761-b7bf-55d38d397860 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:11.591104 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-dd6265f2-b45e-4761-b7bf-55d38d397860 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:11.732195 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-dd6265f2-b45e-4761-b7bf-55d38d397860 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:11.741822 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-dd6265f2-b45e-4761-b7bf-55d38d397860 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1688 microversion: 2.1 time: 0.165743 Aug 31 13:07:11.742409 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 359/700] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:07:11 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:07:12.351780 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-a31a754d-28e5-4aee-b1e0-0d40f350288e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:12.352404 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-a31a754d-28e5-4aee-b1e0-0d40f350288e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 49803c3f-e096-4c19-a579-3224e6fe2809] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:12.359636 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a31a754d-28e5-4aee-b1e0-0d40f350288e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:12.360259 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a31a754d-28e5-4aee-b1e0-0d40f350288e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:12.360752 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a31a754d-28e5-4aee-b1e0-0d40f350288e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:12.361590 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a31a754d-28e5-4aee-b1e0-0d40f350288e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:12.362117 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a31a754d-28e5-4aee-b1e0-0d40f350288e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:12.362797 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a31a754d-28e5-4aee-b1e0-0d40f350288e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:12.445905 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-a31a754d-28e5-4aee-b1e0-0d40f350288e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:12.458408 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-a31a754d-28e5-4aee-b1e0-0d40f350288e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809" status: 200 len: 1295 microversion: 2.1 time: 0.110452 Aug 31 13:07:12.459106 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 342/701] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:07:12 2022] GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809 => generated 1295 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:07:12.762953 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-9e0a405b-2408-4f33-a9b5-6590741733f4 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:12.764946 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-9e0a405b-2408-4f33-a9b5-6590741733f4 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:12.774771 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9e0a405b-2408-4f33-a9b5-6590741733f4 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:12.775220 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9e0a405b-2408-4f33-a9b5-6590741733f4 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:12.775865 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9e0a405b-2408-4f33-a9b5-6590741733f4 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:12.777261 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9e0a405b-2408-4f33-a9b5-6590741733f4 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:12.777921 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9e0a405b-2408-4f33-a9b5-6590741733f4 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:12.778571 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9e0a405b-2408-4f33-a9b5-6590741733f4 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:12.867451 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-9e0a405b-2408-4f33-a9b5-6590741733f4 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:12.878218 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-9e0a405b-2408-4f33-a9b5-6590741733f4 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1621 microversion: 2.1 time: 0.119287 Aug 31 13:07:12.879642 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 360/702] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:07:12 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1621 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:07:13.097436 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-ea35fc02-e1a2-4e27-bcae-865e08ef7c93 req-ae126e45-efcf-4a2b-91c6-d140b781c205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec", "name": "network-vif-deleted", "tag": "d45b253a-763d-4df7-b467-4cfc91042795"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:07:13.108516 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-ea35fc02-e1a2-4e27-bcae-865e08ef7c93 req-ae126e45-efcf-4a2b-91c6-d140b781c205 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:13.109252 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-ea35fc02-e1a2-4e27-bcae-865e08ef7c93 req-ae126e45-efcf-4a2b-91c6-d140b781c205 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:13.109892 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-ea35fc02-e1a2-4e27-bcae-865e08ef7c93 req-ae126e45-efcf-4a2b-91c6-d140b781c205 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:13.122358 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-ea35fc02-e1a2-4e27-bcae-865e08ef7c93 req-ae126e45-efcf-4a2b-91c6-d140b781c205 service nova] Creating event network-vif-deleted:d45b253a-763d-4df7-b467-4cfc91042795 for instance dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec on hv-cinder-85442 Aug 31 13:07:13.128259 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-ea35fc02-e1a2-4e27-bcae-865e08ef7c93 req-ae126e45-efcf-4a2b-91c6-d140b781c205 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036190 Aug 31 13:07:13.133195 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 343/703] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:07:13.480800 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-8a92a8fa-bea2-4eca-8608-0a03f4b04179 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:13.482169 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-8a92a8fa-bea2-4eca-8608-0a03f4b04179 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 49803c3f-e096-4c19-a579-3224e6fe2809] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:13.489218 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8a92a8fa-bea2-4eca-8608-0a03f4b04179 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:13.489913 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8a92a8fa-bea2-4eca-8608-0a03f4b04179 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:13.490521 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8a92a8fa-bea2-4eca-8608-0a03f4b04179 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:13.491862 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8a92a8fa-bea2-4eca-8608-0a03f4b04179 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:13.492495 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8a92a8fa-bea2-4eca-8608-0a03f4b04179 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:13.493335 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8a92a8fa-bea2-4eca-8608-0a03f4b04179 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:13.700968 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-8a92a8fa-bea2-4eca-8608-0a03f4b04179 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:13.709462 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-8a92a8fa-bea2-4eca-8608-0a03f4b04179 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809" status: 200 len: 1363 microversion: 2.1 time: 0.233728 Aug 31 13:07:13.710365 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 361/704] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:07:13 2022] GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809 => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:07:13.772150 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-074ba38c-ec20-435a-9bbd-abf360e725a1 req-18c24821-e568-4c01-b78c-eadde20b6604 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49803c3f-e096-4c19-a579-3224e6fe2809", "tag": "923b79d0-6af1-44fa-a04c-563b471d4ada"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:07:13.782278 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-074ba38c-ec20-435a-9bbd-abf360e725a1 req-18c24821-e568-4c01-b78c-eadde20b6604 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:13.782732 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-074ba38c-ec20-435a-9bbd-abf360e725a1 req-18c24821-e568-4c01-b78c-eadde20b6604 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:13.783383 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-074ba38c-ec20-435a-9bbd-abf360e725a1 req-18c24821-e568-4c01-b78c-eadde20b6604 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:13.795670 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-074ba38c-ec20-435a-9bbd-abf360e725a1 req-18c24821-e568-4c01-b78c-eadde20b6604 service nova] Creating event network-changed:923b79d0-6af1-44fa-a04c-563b471d4ada for instance 49803c3f-e096-4c19-a579-3224e6fe2809 on hv-cinder-85442 Aug 31 13:07:13.800611 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-074ba38c-ec20-435a-9bbd-abf360e725a1 req-18c24821-e568-4c01-b78c-eadde20b6604 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033173 Aug 31 13:07:13.801223 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 344/705] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:07:13.901775 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-080f350f-4d6a-4348-a576-a2e1949317c3 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:13.902311 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-080f350f-4d6a-4348-a576-a2e1949317c3 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:13.908761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-080f350f-4d6a-4348-a576-a2e1949317c3 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:13.909245 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-080f350f-4d6a-4348-a576-a2e1949317c3 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:13.909677 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-080f350f-4d6a-4348-a576-a2e1949317c3 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:13.910368 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-080f350f-4d6a-4348-a576-a2e1949317c3 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:13.910817 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-080f350f-4d6a-4348-a576-a2e1949317c3 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:13.911217 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-080f350f-4d6a-4348-a576-a2e1949317c3 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:13.943199 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-080f350f-4d6a-4348-a576-a2e1949317c3 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:13.943684 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-080f350f-4d6a-4348-a576-a2e1949317c3 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:13.944114 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-080f350f-4d6a-4348-a576-a2e1949317c3 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:13.944889 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.objects.instance [None req-080f350f-4d6a-4348-a576-a2e1949317c3 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lazy-loading 'fault' on Instance uuid dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec {{(pid=120704) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 13:07:13.990359 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-080f350f-4d6a-4348-a576-a2e1949317c3 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:13.998433 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-080f350f-4d6a-4348-a576-a2e1949317c3 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 200 len: 1335 microversion: 2.1 time: 0.100575 Aug 31 13:07:13.999083 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 362/706] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:07:13 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 1335 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:07:14.731485 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e76a6bdb-70ae-46cf-8601-188be3dbd853 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:14.732307 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e76a6bdb-70ae-46cf-8601-188be3dbd853 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 49803c3f-e096-4c19-a579-3224e6fe2809] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:14.739862 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e76a6bdb-70ae-46cf-8601-188be3dbd853 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:14.740383 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e76a6bdb-70ae-46cf-8601-188be3dbd853 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:14.740790 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e76a6bdb-70ae-46cf-8601-188be3dbd853 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:14.741578 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e76a6bdb-70ae-46cf-8601-188be3dbd853 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:14.742073 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e76a6bdb-70ae-46cf-8601-188be3dbd853 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:14.742542 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e76a6bdb-70ae-46cf-8601-188be3dbd853 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:14.925126 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e76a6bdb-70ae-46cf-8601-188be3dbd853 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:14.932995 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e76a6bdb-70ae-46cf-8601-188be3dbd853 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809" status: 200 len: 1363 microversion: 2.1 time: 0.206029 Aug 31 13:07:14.933566 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 345/707] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:07:14 2022] GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809 => generated 1363 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:07:15.018919 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-0fd672bf-8f28-40bb-a282-78f2659fdcb3 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:15.019639 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-0fd672bf-8f28-40bb-a282-78f2659fdcb3 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:15.026701 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0fd672bf-8f28-40bb-a282-78f2659fdcb3 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:15.027071 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0fd672bf-8f28-40bb-a282-78f2659fdcb3 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:15.027495 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0fd672bf-8f28-40bb-a282-78f2659fdcb3 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:15.028221 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0fd672bf-8f28-40bb-a282-78f2659fdcb3 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:15.028663 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0fd672bf-8f28-40bb-a282-78f2659fdcb3 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:15.029086 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0fd672bf-8f28-40bb-a282-78f2659fdcb3 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:15.043476 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.wsgi [None req-0fd672bf-8f28-40bb-a282-78f2659fdcb3 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] HTTP exception thrown: Instance dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec could not be found. Aug 31 13:07:15.045175 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-0fd672bf-8f28-40bb-a282-78f2659fdcb3 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Request method failure captured: Aug 31 13:07:15.045175 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: request: GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec HTTP/1.1 Aug 31 13:07:15.045175 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept: application/json Aug 31 13:07:15.045175 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept-Encoding: identity Aug 31 13:07:15.045175 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Connection: close Aug 31 13:07:15.045175 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Length: 0 Aug 31 13:07:15.045175 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Type: application/json Aug 31 13:07:15.045175 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Host: 10.222.0.58 Aug 31 13:07:15.045175 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Openstack-System-Scope: None Aug 31 13:07:15.045175 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: User-Agent: python-urllib3/1.26.12 Aug 31 13:07:15.045175 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Auth-Token: gAAAAABjD1sZ8K-CuXjoyInmbyCWcKQ2hvstKdaDVHuGOcX86HAp1ceK2FrO69nhO1vsmo_DJ17VxZ7XFBhtbbOOVHhczRe79dWAWnBV79vGZeTskL4gRVzpkATTbtMz8tRcPwNEiHgyNNxRUIMKgIXrh9QhenjZON35FkHfV2_WQxqR1mNYfOg Aug 31 13:07:15.045175 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Id: None Aug 31 13:07:15.045175 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Name: None Aug 31 13:07:15.045175 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Identity-Status: Confirmed Aug 31 13:07:15.045175 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Is-Admin-Project: True Aug 31 13:07:15.045175 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Id: default Aug 31 13:07:15.045175 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Name: Default Aug 31 13:07:15.045175 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Id: b5b2950890c04cff868553069d6aba9a Aug 31 13:07:15.045175 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1816283264 Aug 31 13:07:15.045175 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Role: member,reader Aug 31 13:07:15.045175 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Roles: member,reader Aug 31 13:07:15.046773 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b5b2950890c04cff868553069d6aba9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b5b2950890c04cff868553069d6aba9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b5b2950890c04cff868553069d6aba9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b5b2950890c04cff868553069d6aba9a"}]}] Aug 31 13:07:15.046773 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1816283264 Aug 31 13:07:15.046773 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Id: b5b2950890c04cff868553069d6aba9a Aug 31 13:07:15.046773 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1816283264 Aug 31 13:07:15.046773 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User: tempest-ServerRescueNegativeTestJSON-1816283264-project Aug 31 13:07:15.046773 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Id: default Aug 31 13:07:15.046773 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Name: Default Aug 31 13:07:15.046773 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Id: 32770594db4f437a958fd8c2c145a865 Aug 31 13:07:15.046773 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1816283264-project Aug 31 13:07:15.046773 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: method: > Aug 31 13:07:15.046773 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: exception: Instance dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec could not be found. Aug 31 13:07:15.046773 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: action_args: {'id': 'dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec'} Aug 31 13:07:15.047672 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:07:15.047672 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:07:15.047672 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 13:07:15.047672 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 13:07:15.047672 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 13:07:15.047672 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 13:07:15.047672 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 13:07:15.047672 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 13:07:15.047672 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 13:07:15.047672 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 13:07:15.047672 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec could not be found. Aug 31 13:07:15.047672 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:07:15.047672 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:07:15.047672 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:07:15.047672 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:07:15.047672 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:07:15.047672 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:07:15.047672 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:07:15.047672 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:07:15.047672 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:07:15.048931 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:07:15.048931 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 13:07:15.048931 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 13:07:15.048931 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 13:07:15.048931 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 13:07:15.048931 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 13:07:15.048931 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 13:07:15.048931 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec could not be found. Aug 31 13:07:15.048931 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:07:15.048931 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:07:15.048931 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:07:15.048931 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:07:15.048931 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:07:15.048931 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:07:15.048931 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:07:15.048931 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:07:15.048931 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec could not be found. Aug 31 13:07:15.048931 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:07:15.049992 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-0fd672bf-8f28-40bb-a282-78f2659fdcb3 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Returning 404 to user: Instance dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec could not be found. {{(pid=120704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:07:15.049992 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-0fd672bf-8f28-40bb-a282-78f2659fdcb3 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec" status: 404 len: 111 microversion: 2.1 time: 0.031644 Aug 31 13:07:15.049992 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 363/708] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:07:15 2022] GET /compute/v2.1/servers/dba50f17-f2c6-41c7-b4b4-7d838e0cc5ec => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:07:15.055704 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-73f83ba8-3bad-4fe4-a179-649e79ab32d4 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '.version_select at 0x7f1951378670>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:15.075711 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-73f83ba8-3bad-4fe4-a179-649e79ab32d4 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-595504711" status: 202 len: 0 microversion: 2.1 time: 0.023929 Aug 31 13:07:15.076396 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 346/709] 10.222.0.58 () {58 vars in 1218 bytes} [Wed Aug 31 13:07:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-595504711 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:07:15.954943 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-d2648315-b95c-446b-9b18-469ec51e304e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:15.955917 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-d2648315-b95c-446b-9b18-469ec51e304e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 49803c3f-e096-4c19-a579-3224e6fe2809] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:15.964256 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d2648315-b95c-446b-9b18-469ec51e304e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:15.964804 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d2648315-b95c-446b-9b18-469ec51e304e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:15.965240 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d2648315-b95c-446b-9b18-469ec51e304e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:15.965933 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d2648315-b95c-446b-9b18-469ec51e304e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:15.966379 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d2648315-b95c-446b-9b18-469ec51e304e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:15.966818 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d2648315-b95c-446b-9b18-469ec51e304e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:16.103837 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-d2648315-b95c-446b-9b18-469ec51e304e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:16.112174 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-d2648315-b95c-446b-9b18-469ec51e304e tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809" status: 200 len: 1363 microversion: 2.1 time: 0.161872 Aug 31 13:07:16.112743 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 364/710] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:07:15 2022] GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:07:17.133368 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-a8673305-f545-4943-aefd-8bb53a734e46 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:17.133973 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-a8673305-f545-4943-aefd-8bb53a734e46 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 49803c3f-e096-4c19-a579-3224e6fe2809] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:17.140316 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a8673305-f545-4943-aefd-8bb53a734e46 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:17.140792 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a8673305-f545-4943-aefd-8bb53a734e46 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:17.141231 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a8673305-f545-4943-aefd-8bb53a734e46 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:17.141919 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a8673305-f545-4943-aefd-8bb53a734e46 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:17.142371 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a8673305-f545-4943-aefd-8bb53a734e46 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:17.142801 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a8673305-f545-4943-aefd-8bb53a734e46 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:17.277106 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-a8673305-f545-4943-aefd-8bb53a734e46 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:17.286190 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-a8673305-f545-4943-aefd-8bb53a734e46 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809" status: 200 len: 1363 microversion: 2.1 time: 0.157432 Aug 31 13:07:17.287224 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 347/711] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:07:17 2022] GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:07:18.141760 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-2ac4c119-ee2a-4ffd-9af7-0d5efb2c84cf tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:18.142285 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-2ac4c119-ee2a-4ffd-9af7-0d5efb2c84cf tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:18.149383 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2ac4c119-ee2a-4ffd-9af7-0d5efb2c84cf tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:18.149885 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2ac4c119-ee2a-4ffd-9af7-0d5efb2c84cf tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:18.150297 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2ac4c119-ee2a-4ffd-9af7-0d5efb2c84cf tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:18.151011 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2ac4c119-ee2a-4ffd-9af7-0d5efb2c84cf tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:18.151452 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2ac4c119-ee2a-4ffd-9af7-0d5efb2c84cf tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:18.151900 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2ac4c119-ee2a-4ffd-9af7-0d5efb2c84cf tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:18.170397 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:18.179224 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-2ac4c119-ee2a-4ffd-9af7-0d5efb2c84cf tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Going to try to terminate instance {{(pid=120704) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 13:07:18.262223 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-2ac4c119-ee2a-4ffd-9af7-0d5efb2c84cf tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "DELETE /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 204 len: 0 microversion: 2.1 time: 0.123966 Aug 31 13:07:18.262739 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 365/712] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 31 13:07:18 2022] DELETE /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:07:18.271629 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e0e861b9-0969-4563-b47d-4bca823a0ce4 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:18.272271 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e0e861b9-0969-4563-b47d-4bca823a0ce4 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:18.278780 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e0e861b9-0969-4563-b47d-4bca823a0ce4 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:18.279273 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e0e861b9-0969-4563-b47d-4bca823a0ce4 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:18.279715 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e0e861b9-0969-4563-b47d-4bca823a0ce4 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:18.280434 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e0e861b9-0969-4563-b47d-4bca823a0ce4 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:18.280884 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e0e861b9-0969-4563-b47d-4bca823a0ce4 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:18.281626 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e0e861b9-0969-4563-b47d-4bca823a0ce4 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:18.314636 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-0f2f3405-79f9-4a0b-a587-1ffb28885287 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:18.315441 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-0f2f3405-79f9-4a0b-a587-1ffb28885287 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 49803c3f-e096-4c19-a579-3224e6fe2809] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:18.322126 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0f2f3405-79f9-4a0b-a587-1ffb28885287 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:18.322788 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0f2f3405-79f9-4a0b-a587-1ffb28885287 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:18.323229 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0f2f3405-79f9-4a0b-a587-1ffb28885287 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:18.324014 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0f2f3405-79f9-4a0b-a587-1ffb28885287 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:18.324431 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0f2f3405-79f9-4a0b-a587-1ffb28885287 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:18.324851 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0f2f3405-79f9-4a0b-a587-1ffb28885287 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:18.462202 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e0e861b9-0969-4563-b47d-4bca823a0ce4 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:18.465878 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:18.470989 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e0e861b9-0969-4563-b47d-4bca823a0ce4 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1508 microversion: 2.1 time: 0.203342 Aug 31 13:07:18.471648 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 348/713] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:07:18 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1508 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:07:18.488037 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-0f2f3405-79f9-4a0b-a587-1ffb28885287 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:18.496083 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-0f2f3405-79f9-4a0b-a587-1ffb28885287 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809" status: 200 len: 1363 microversion: 2.1 time: 0.185761 Aug 31 13:07:18.496663 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 366/714] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:07:18 2022] GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:07:19.492351 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-010723d1-63c8-408e-8b58-252f9693fa8c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:19.493066 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-010723d1-63c8-408e-8b58-252f9693fa8c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:19.495394 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=2 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:19.502667 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-010723d1-63c8-408e-8b58-252f9693fa8c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:19.503227 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-010723d1-63c8-408e-8b58-252f9693fa8c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:19.503903 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-010723d1-63c8-408e-8b58-252f9693fa8c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:19.504835 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-010723d1-63c8-408e-8b58-252f9693fa8c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:19.505349 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-010723d1-63c8-408e-8b58-252f9693fa8c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:19.505829 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-010723d1-63c8-408e-8b58-252f9693fa8c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:19.524467 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-dcc89763-79b7-4862-8d24-8ce137b678da tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:19.527766 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-dcc89763-79b7-4862-8d24-8ce137b678da tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 49803c3f-e096-4c19-a579-3224e6fe2809] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:19.532479 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell0:SELECT=2 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:19.533914 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell0:SELECT=10 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:19.542518 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-dcc89763-79b7-4862-8d24-8ce137b678da tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:19.543424 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-dcc89763-79b7-4862-8d24-8ce137b678da tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:19.544250 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-dcc89763-79b7-4862-8d24-8ce137b678da tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:19.545171 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-dcc89763-79b7-4862-8d24-8ce137b678da tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:19.545825 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-dcc89763-79b7-4862-8d24-8ce137b678da tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:19.546430 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-dcc89763-79b7-4862-8d24-8ce137b678da tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:19.801514 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-010723d1-63c8-408e-8b58-252f9693fa8c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:19.810551 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-010723d1-63c8-408e-8b58-252f9693fa8c tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 200 len: 1508 microversion: 2.1 time: 0.321739 Aug 31 13:07:19.811074 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 349/715] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:07:19 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 1508 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:07:19.815665 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-0e5502d3-8599-4406-8d66-f921d6189849 req-9bbeb071-2235-4493-ae00-32409bee7d37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de7a8eee-34d7-45c9-bbc0-5b9f954776e7", "name": "network-vif-deleted", "tag": "f29a1e36-6b6c-465b-971e-9130133909df"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:07:19.823404 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-dcc89763-79b7-4862-8d24-8ce137b678da tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:19.825574 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-0e5502d3-8599-4406-8d66-f921d6189849 req-9bbeb071-2235-4493-ae00-32409bee7d37 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:19.826043 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-0e5502d3-8599-4406-8d66-f921d6189849 req-9bbeb071-2235-4493-ae00-32409bee7d37 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:19.826463 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-0e5502d3-8599-4406-8d66-f921d6189849 req-9bbeb071-2235-4493-ae00-32409bee7d37 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:19.834873 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-dcc89763-79b7-4862-8d24-8ce137b678da tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809" status: 200 len: 1363 microversion: 2.1 time: 0.315224 Aug 31 13:07:19.835851 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 367/716] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:07:19 2022] GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809 => generated 1363 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:07:19.844683 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-0e5502d3-8599-4406-8d66-f921d6189849 req-9bbeb071-2235-4493-ae00-32409bee7d37 service nova] Creating event network-vif-deleted:f29a1e36-6b6c-465b-971e-9130133909df for instance de7a8eee-34d7-45c9-bbc0-5b9f954776e7 on hv-cinder-85442 Aug 31 13:07:19.850383 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-0e5502d3-8599-4406-8d66-f921d6189849 req-9bbeb071-2235-4493-ae00-32409bee7d37 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038142 Aug 31 13:07:19.850986 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 350/717] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:07:20.806759 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-69386942-56a0-427d-ae81-30077b0ed1f3 req-262f95a9-91f5-4060-8b32-ccc634dfce0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49803c3f-e096-4c19-a579-3224e6fe2809", "name": "network-vif-plugged", "status": "completed", "tag": "923b79d0-6af1-44fa-a04c-563b471d4ada"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:07:20.817037 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-69386942-56a0-427d-ae81-30077b0ed1f3 req-262f95a9-91f5-4060-8b32-ccc634dfce0c service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:20.817505 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-69386942-56a0-427d-ae81-30077b0ed1f3 req-262f95a9-91f5-4060-8b32-ccc634dfce0c service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:20.818102 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-69386942-56a0-427d-ae81-30077b0ed1f3 req-262f95a9-91f5-4060-8b32-ccc634dfce0c service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:20.831459 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-69386942-56a0-427d-ae81-30077b0ed1f3 req-262f95a9-91f5-4060-8b32-ccc634dfce0c service nova] Creating event network-vif-plugged:923b79d0-6af1-44fa-a04c-563b471d4ada for instance 49803c3f-e096-4c19-a579-3224e6fe2809 on hv-cinder-85442 Aug 31 13:07:20.832144 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-0b853443-b45d-4f15-bfe9-1fad0e85e466 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:20.832964 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-0b853443-b45d-4f15-bfe9-1fad0e85e466 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: de7a8eee-34d7-45c9-bbc0-5b9f954776e7] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:20.836725 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-69386942-56a0-427d-ae81-30077b0ed1f3 req-262f95a9-91f5-4060-8b32-ccc634dfce0c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033805 Aug 31 13:07:20.837443 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 368/718] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:07:20.839919 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0b853443-b45d-4f15-bfe9-1fad0e85e466 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:20.840457 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0b853443-b45d-4f15-bfe9-1fad0e85e466 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:20.840961 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0b853443-b45d-4f15-bfe9-1fad0e85e466 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:20.841795 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0b853443-b45d-4f15-bfe9-1fad0e85e466 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:20.842308 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0b853443-b45d-4f15-bfe9-1fad0e85e466 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:20.842734 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0b853443-b45d-4f15-bfe9-1fad0e85e466 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:20.857240 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-0b853443-b45d-4f15-bfe9-1fad0e85e466 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] HTTP exception thrown: Instance de7a8eee-34d7-45c9-bbc0-5b9f954776e7 could not be found. Aug 31 13:07:20.857805 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-fc04dddd-6c3c-462a-ace1-f3afba3c7301 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:20.858488 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-fc04dddd-6c3c-462a-ace1-f3afba3c7301 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 49803c3f-e096-4c19-a579-3224e6fe2809] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:20.859126 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-0b853443-b45d-4f15-bfe9-1fad0e85e466 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Request method failure captured: Aug 31 13:07:20.859126 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: request: GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 HTTP/1.1 Aug 31 13:07:20.859126 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 31 13:07:20.859126 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 31 13:07:20.859126 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Connection: close Aug 31 13:07:20.859126 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 31 13:07:20.859126 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 31 13:07:20.859126 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Host: 10.222.0.58 Aug 31 13:07:20.859126 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 31 13:07:20.859126 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 31 13:07:20.859126 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjD1sZ8K-CuXjoyInmbyCWcKQ2hvstKdaDVHuGOcX86HAp1ceK2FrO69nhO1vsmo_DJ17VxZ7XFBhtbbOOVHhczRe79dWAWnBV79vGZeTskL4gRVzpkATTbtMz8tRcPwNEiHgyNNxRUIMKgIXrh9QhenjZON35FkHfV2_WQxqR1mNYfOg Aug 31 13:07:20.859126 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 31 13:07:20.859126 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 31 13:07:20.859126 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 31 13:07:20.859126 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 31 13:07:20.859126 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 31 13:07:20.859126 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 31 13:07:20.859126 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Id: b5b2950890c04cff868553069d6aba9a Aug 31 13:07:20.859126 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1816283264 Aug 31 13:07:20.859126 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Role: member,reader Aug 31 13:07:20.859126 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Roles: member,reader Aug 31 13:07:20.860573 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b5b2950890c04cff868553069d6aba9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b5b2950890c04cff868553069d6aba9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b5b2950890c04cff868553069d6aba9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b5b2950890c04cff868553069d6aba9a"}]}] Aug 31 13:07:20.860573 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1816283264 Aug 31 13:07:20.860573 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant-Id: b5b2950890c04cff868553069d6aba9a Aug 31 13:07:20.860573 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1816283264 Aug 31 13:07:20.860573 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User: tempest-ServerRescueNegativeTestJSON-1816283264-project Aug 31 13:07:20.860573 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 31 13:07:20.860573 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 31 13:07:20.860573 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Id: 32770594db4f437a958fd8c2c145a865 Aug 31 13:07:20.860573 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1816283264-project Aug 31 13:07:20.860573 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: method: > Aug 31 13:07:20.860573 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: exception: Instance de7a8eee-34d7-45c9-bbc0-5b9f954776e7 could not be found. Aug 31 13:07:20.860573 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: action_args: {'id': 'de7a8eee-34d7-45c9-bbc0-5b9f954776e7'} Aug 31 13:07:20.861438 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:07:20.861438 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:07:20.861438 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 13:07:20.861438 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 13:07:20.861438 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 13:07:20.861438 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 13:07:20.861438 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 13:07:20.861438 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 13:07:20.861438 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 13:07:20.861438 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 13:07:20.861438 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de7a8eee-34d7-45c9-bbc0-5b9f954776e7 could not be found. Aug 31 13:07:20.861438 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:07:20.861438 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:07:20.861438 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:07:20.861438 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:07:20.861438 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:07:20.861438 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:07:20.861438 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:07:20.861438 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:07:20.861438 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:07:20.865036 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:07:20.865036 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 13:07:20.865036 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 13:07:20.865036 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 13:07:20.865036 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 13:07:20.865036 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 13:07:20.865036 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 13:07:20.865036 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de7a8eee-34d7-45c9-bbc0-5b9f954776e7 could not be found. Aug 31 13:07:20.865036 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:07:20.865036 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:07:20.865036 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:07:20.865036 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:07:20.865036 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:07:20.865036 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:07:20.865036 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:07:20.865036 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:07:20.865036 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de7a8eee-34d7-45c9-bbc0-5b9f954776e7 could not be found. Aug 31 13:07:20.865036 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:07:20.868482 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-0b853443-b45d-4f15-bfe9-1fad0e85e466 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Returning 404 to user: Instance de7a8eee-34d7-45c9-bbc0-5b9f954776e7 could not be found. {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:07:20.868482 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-0b853443-b45d-4f15-bfe9-1fad0e85e466 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7" status: 404 len: 111 microversion: 2.1 time: 0.033914 Aug 31 13:07:20.868482 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 351/719] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:07:20 2022] GET /compute/v2.1/servers/de7a8eee-34d7-45c9-bbc0-5b9f954776e7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 13:07:20.868949 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fc04dddd-6c3c-462a-ace1-f3afba3c7301 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:20.868949 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fc04dddd-6c3c-462a-ace1-f3afba3c7301 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:20.868949 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fc04dddd-6c3c-462a-ace1-f3afba3c7301 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:20.868949 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fc04dddd-6c3c-462a-ace1-f3afba3c7301 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:20.869482 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fc04dddd-6c3c-462a-ace1-f3afba3c7301 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:20.869482 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fc04dddd-6c3c-462a-ace1-f3afba3c7301 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:20.871977 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-7fd91f8b-e5d4-48c7-af97-dd2bad20e6fc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:20.872589 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-7fd91f8b-e5d4-48c7-af97-dd2bad20e6fc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: f97b98c1-e7be-4c90-8c65-715135db482b] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:20.879232 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7fd91f8b-e5d4-48c7-af97-dd2bad20e6fc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:20.879761 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7fd91f8b-e5d4-48c7-af97-dd2bad20e6fc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:20.880442 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7fd91f8b-e5d4-48c7-af97-dd2bad20e6fc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:20.881339 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7fd91f8b-e5d4-48c7-af97-dd2bad20e6fc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:20.881788 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7fd91f8b-e5d4-48c7-af97-dd2bad20e6fc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:20.882177 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7fd91f8b-e5d4-48c7-af97-dd2bad20e6fc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:20.915263 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-7fd91f8b-e5d4-48c7-af97-dd2bad20e6fc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: f97b98c1-e7be-4c90-8c65-715135db482b] Going to try to terminate instance {{(pid=120705) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 13:07:21.012282 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-7fd91f8b-e5d4-48c7-af97-dd2bad20e6fc tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b" status: 204 len: 0 microversion: 2.1 time: 0.145126 Aug 31 13:07:21.013681 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 352/720] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 31 13:07:20 2022] DELETE /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:07:21.017483 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-fc04dddd-6c3c-462a-ace1-f3afba3c7301 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:21.022200 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-990d6008-21ec-444f-810a-36c5ec525e79 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:21.023013 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-990d6008-21ec-444f-810a-36c5ec525e79 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: f97b98c1-e7be-4c90-8c65-715135db482b] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:21.026053 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-fc04dddd-6c3c-462a-ace1-f3afba3c7301 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809" status: 200 len: 1363 microversion: 2.1 time: 0.172334 Aug 31 13:07:21.026553 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 369/721] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:07:20 2022] GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:07:21.029518 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-990d6008-21ec-444f-810a-36c5ec525e79 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:21.030000 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-990d6008-21ec-444f-810a-36c5ec525e79 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:21.030434 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-990d6008-21ec-444f-810a-36c5ec525e79 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:21.031126 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-990d6008-21ec-444f-810a-36c5ec525e79 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:21.032147 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-990d6008-21ec-444f-810a-36c5ec525e79 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:21.032567 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-990d6008-21ec-444f-810a-36c5ec525e79 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:21.171597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-990d6008-21ec-444f-810a-36c5ec525e79 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:21.180054 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-990d6008-21ec-444f-810a-36c5ec525e79 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b" status: 200 len: 1521 microversion: 2.1 time: 0.162098 Aug 31 13:07:21.180623 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 353/722] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:07:21 2022] GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:07:22.056070 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-e2b2fb8a-4ab0-4611-9606-9e3f806b5ba0 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:22.056998 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-e2b2fb8a-4ab0-4611-9606-9e3f806b5ba0 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 49803c3f-e096-4c19-a579-3224e6fe2809] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:22.067375 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e2b2fb8a-4ab0-4611-9606-9e3f806b5ba0 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:22.067991 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e2b2fb8a-4ab0-4611-9606-9e3f806b5ba0 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:22.068536 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e2b2fb8a-4ab0-4611-9606-9e3f806b5ba0 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:22.069343 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e2b2fb8a-4ab0-4611-9606-9e3f806b5ba0 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:22.069870 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e2b2fb8a-4ab0-4611-9606-9e3f806b5ba0 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:22.070361 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e2b2fb8a-4ab0-4611-9606-9e3f806b5ba0 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:22.201226 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-a04bc32e-4b48-48c8-976b-d86b63ffb71e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:22.201834 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-a04bc32e-4b48-48c8-976b-d86b63ffb71e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: f97b98c1-e7be-4c90-8c65-715135db482b] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:22.203461 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-e2b2fb8a-4ab0-4611-9606-9e3f806b5ba0 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:22.208854 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a04bc32e-4b48-48c8-976b-d86b63ffb71e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:22.209329 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a04bc32e-4b48-48c8-976b-d86b63ffb71e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:22.209986 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a04bc32e-4b48-48c8-976b-d86b63ffb71e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:22.210687 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a04bc32e-4b48-48c8-976b-d86b63ffb71e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:22.211135 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a04bc32e-4b48-48c8-976b-d86b63ffb71e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:22.211487 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-e2b2fb8a-4ab0-4611-9606-9e3f806b5ba0 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809" status: 200 len: 1363 microversion: 2.1 time: 0.160688 Aug 31 13:07:22.211606 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a04bc32e-4b48-48c8-976b-d86b63ffb71e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:22.212105 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 370/723] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:07:22 2022] GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:07:22.349903 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-a04bc32e-4b48-48c8-976b-d86b63ffb71e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:22.358264 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-a04bc32e-4b48-48c8-976b-d86b63ffb71e tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b" status: 200 len: 1521 microversion: 2.1 time: 0.160948 Aug 31 13:07:22.358834 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 354/724] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:07:22 2022] GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:07:23.190396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-b0df1d30-d606-4bab-b1c3-913b9cfd6b8b req-2352f01d-9555-48c4-899e-6b17ef73f811 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f97b98c1-e7be-4c90-8c65-715135db482b", "name": "network-vif-deleted", "tag": "02f6e7e8-3148-4cb2-917c-2e387bedf92c"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:07:23.200654 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-b0df1d30-d606-4bab-b1c3-913b9cfd6b8b req-2352f01d-9555-48c4-899e-6b17ef73f811 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:23.201158 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-b0df1d30-d606-4bab-b1c3-913b9cfd6b8b req-2352f01d-9555-48c4-899e-6b17ef73f811 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:23.201588 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-b0df1d30-d606-4bab-b1c3-913b9cfd6b8b req-2352f01d-9555-48c4-899e-6b17ef73f811 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:23.213367 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-b0df1d30-d606-4bab-b1c3-913b9cfd6b8b req-2352f01d-9555-48c4-899e-6b17ef73f811 service nova] Creating event network-vif-deleted:02f6e7e8-3148-4cb2-917c-2e387bedf92c for instance f97b98c1-e7be-4c90-8c65-715135db482b on hv-cinder-85442 Aug 31 13:07:23.218486 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-b0df1d30-d606-4bab-b1c3-913b9cfd6b8b req-2352f01d-9555-48c4-899e-6b17ef73f811 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032055 Aug 31 13:07:23.219360 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 371/725] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:07:23.232135 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e5bc44f2-fb3f-4c09-bd4c-53118046eae1 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:23.233504 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e5bc44f2-fb3f-4c09-bd4c-53118046eae1 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 49803c3f-e096-4c19-a579-3224e6fe2809] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:23.240431 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e5bc44f2-fb3f-4c09-bd4c-53118046eae1 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:23.240912 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e5bc44f2-fb3f-4c09-bd4c-53118046eae1 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:23.241344 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e5bc44f2-fb3f-4c09-bd4c-53118046eae1 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:23.242046 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e5bc44f2-fb3f-4c09-bd4c-53118046eae1 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:23.242495 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e5bc44f2-fb3f-4c09-bd4c-53118046eae1 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:23.242940 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e5bc44f2-fb3f-4c09-bd4c-53118046eae1 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:23.376547 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e5bc44f2-fb3f-4c09-bd4c-53118046eae1 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:23.380071 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-7456d2e1-c85e-4e55-90ed-cefb85385eba tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:23.381074 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-7456d2e1-c85e-4e55-90ed-cefb85385eba tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: f97b98c1-e7be-4c90-8c65-715135db482b] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:23.387955 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e5bc44f2-fb3f-4c09-bd4c-53118046eae1 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809" status: 200 len: 1549 microversion: 2.1 time: 0.159655 Aug 31 13:07:23.388661 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 355/726] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:07:23 2022] GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809 => generated 1549 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:07:23.389078 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7456d2e1-c85e-4e55-90ed-cefb85385eba tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:23.389562 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7456d2e1-c85e-4e55-90ed-cefb85385eba tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:23.389996 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7456d2e1-c85e-4e55-90ed-cefb85385eba tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:23.390764 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7456d2e1-c85e-4e55-90ed-cefb85385eba tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:23.391217 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7456d2e1-c85e-4e55-90ed-cefb85385eba tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:23.391639 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7456d2e1-c85e-4e55-90ed-cefb85385eba tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:23.409944 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3191c0ca-f941-4001-8493-02ff4edb16bc tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:23.410359 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-3191c0ca-f941-4001-8493-02ff4edb16bc tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 49803c3f-e096-4c19-a579-3224e6fe2809] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:23.416319 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3191c0ca-f941-4001-8493-02ff4edb16bc tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:23.416798 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3191c0ca-f941-4001-8493-02ff4edb16bc tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:23.417236 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3191c0ca-f941-4001-8493-02ff4edb16bc tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:23.417928 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3191c0ca-f941-4001-8493-02ff4edb16bc tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:23.418376 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3191c0ca-f941-4001-8493-02ff4edb16bc tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:23.418832 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3191c0ca-f941-4001-8493-02ff4edb16bc tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:23.457575 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-7456d2e1-c85e-4e55-90ed-cefb85385eba tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32770594db4f437a958fd8c2c145a865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b2950890c04cff868553069d6aba9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:23.467045 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-7456d2e1-c85e-4e55-90ed-cefb85385eba tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b" status: 200 len: 1479 microversion: 2.1 time: 0.092023 Aug 31 13:07:23.467701 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 372/727] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:07:23 2022] GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b => generated 1479 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:07:23.504412 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-3191c0ca-f941-4001-8493-02ff4edb16bc tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098578 Aug 31 13:07:23.505366 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 356/728] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 31 13:07:23 2022] GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:07:24.489273 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-600097f8-ecc0-4f60-aaa1-fbdf229b5118 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:24.489990 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-600097f8-ecc0-4f60-aaa1-fbdf229b5118 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] [instance: f97b98c1-e7be-4c90-8c65-715135db482b] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:24.497050 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-600097f8-ecc0-4f60-aaa1-fbdf229b5118 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:24.497636 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-600097f8-ecc0-4f60-aaa1-fbdf229b5118 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:24.498153 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-600097f8-ecc0-4f60-aaa1-fbdf229b5118 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:24.498939 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-600097f8-ecc0-4f60-aaa1-fbdf229b5118 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:24.499468 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-600097f8-ecc0-4f60-aaa1-fbdf229b5118 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:24.499991 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-600097f8-ecc0-4f60-aaa1-fbdf229b5118 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:24.514565 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.wsgi [None req-600097f8-ecc0-4f60-aaa1-fbdf229b5118 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] HTTP exception thrown: Instance f97b98c1-e7be-4c90-8c65-715135db482b could not be found. Aug 31 13:07:24.516306 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-600097f8-ecc0-4f60-aaa1-fbdf229b5118 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Request method failure captured: Aug 31 13:07:24.516306 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: request: GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b HTTP/1.1 Aug 31 13:07:24.516306 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept: application/json Aug 31 13:07:24.516306 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept-Encoding: identity Aug 31 13:07:24.516306 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Connection: close Aug 31 13:07:24.516306 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Length: 0 Aug 31 13:07:24.516306 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Type: application/json Aug 31 13:07:24.516306 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Host: 10.222.0.58 Aug 31 13:07:24.516306 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Openstack-System-Scope: None Aug 31 13:07:24.516306 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: User-Agent: python-urllib3/1.26.12 Aug 31 13:07:24.516306 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Auth-Token: gAAAAABjD1sZ8K-CuXjoyInmbyCWcKQ2hvstKdaDVHuGOcX86HAp1ceK2FrO69nhO1vsmo_DJ17VxZ7XFBhtbbOOVHhczRe79dWAWnBV79vGZeTskL4gRVzpkATTbtMz8tRcPwNEiHgyNNxRUIMKgIXrh9QhenjZON35FkHfV2_WQxqR1mNYfOg Aug 31 13:07:24.516306 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Id: None Aug 31 13:07:24.516306 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Name: None Aug 31 13:07:24.516306 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Identity-Status: Confirmed Aug 31 13:07:24.516306 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Is-Admin-Project: True Aug 31 13:07:24.516306 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Id: default Aug 31 13:07:24.516306 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Name: Default Aug 31 13:07:24.516306 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Id: b5b2950890c04cff868553069d6aba9a Aug 31 13:07:24.516306 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1816283264 Aug 31 13:07:24.516306 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Role: member,reader Aug 31 13:07:24.516306 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Roles: member,reader Aug 31 13:07:24.517862 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b5b2950890c04cff868553069d6aba9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b5b2950890c04cff868553069d6aba9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b5b2950890c04cff868553069d6aba9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b5b2950890c04cff868553069d6aba9a"}]}] Aug 31 13:07:24.517862 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1816283264 Aug 31 13:07:24.517862 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Id: b5b2950890c04cff868553069d6aba9a Aug 31 13:07:24.517862 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1816283264 Aug 31 13:07:24.517862 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User: tempest-ServerRescueNegativeTestJSON-1816283264-project Aug 31 13:07:24.517862 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Id: default Aug 31 13:07:24.517862 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Name: Default Aug 31 13:07:24.517862 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Id: 32770594db4f437a958fd8c2c145a865 Aug 31 13:07:24.517862 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1816283264-project Aug 31 13:07:24.517862 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: method: > Aug 31 13:07:24.517862 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: exception: Instance f97b98c1-e7be-4c90-8c65-715135db482b could not be found. Aug 31 13:07:24.517862 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: action_args: {'id': 'f97b98c1-e7be-4c90-8c65-715135db482b'} Aug 31 13:07:24.522177 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:07:24.522177 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:07:24.522177 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 13:07:24.522177 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 13:07:24.522177 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 13:07:24.522177 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 13:07:24.522177 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 13:07:24.522177 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 13:07:24.522177 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 13:07:24.522177 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 13:07:24.522177 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f97b98c1-e7be-4c90-8c65-715135db482b could not be found. Aug 31 13:07:24.522177 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:07:24.522177 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:07:24.522177 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:07:24.522177 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:07:24.522177 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:07:24.522177 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:07:24.522177 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:07:24.522177 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:07:24.522177 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:07:24.523516 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:07:24.523516 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 13:07:24.523516 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 13:07:24.523516 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 13:07:24.523516 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 13:07:24.523516 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 13:07:24.523516 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 13:07:24.523516 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f97b98c1-e7be-4c90-8c65-715135db482b could not be found. Aug 31 13:07:24.523516 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:07:24.523516 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:07:24.523516 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:07:24.523516 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:07:24.523516 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:07:24.523516 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:07:24.523516 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:07:24.523516 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:07:24.523516 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f97b98c1-e7be-4c90-8c65-715135db482b could not be found. Aug 31 13:07:24.523516 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:07:24.525314 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-600097f8-ecc0-4f60-aaa1-fbdf229b5118 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] Returning 404 to user: Instance f97b98c1-e7be-4c90-8c65-715135db482b could not be found. {{(pid=120704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:07:24.525314 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-600097f8-ecc0-4f60-aaa1-fbdf229b5118 tempest-ServerRescueNegativeTestJSON-1816283264 tempest-ServerRescueNegativeTestJSON-1816283264-project] 10.222.0.58 "GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b" status: 404 len: 111 microversion: 2.1 time: 0.032763 Aug 31 13:07:24.525314 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 373/729] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:07:24 2022] GET /compute/v2.1/servers/f97b98c1-e7be-4c90-8c65-715135db482b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:07:25.233727 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-93960191-b1a4-470c-85dc-798c8d04af85 req-8aaf9f86-db56-47ff-9ef3-2ee56c584e94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49803c3f-e096-4c19-a579-3224e6fe2809", "tag": "923b79d0-6af1-44fa-a04c-563b471d4ada"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:07:25.244199 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-93960191-b1a4-470c-85dc-798c8d04af85 req-8aaf9f86-db56-47ff-9ef3-2ee56c584e94 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:25.244669 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-93960191-b1a4-470c-85dc-798c8d04af85 req-8aaf9f86-db56-47ff-9ef3-2ee56c584e94 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:25.245086 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-93960191-b1a4-470c-85dc-798c8d04af85 req-8aaf9f86-db56-47ff-9ef3-2ee56c584e94 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:25.256897 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-93960191-b1a4-470c-85dc-798c8d04af85 req-8aaf9f86-db56-47ff-9ef3-2ee56c584e94 service nova] Creating event network-changed:923b79d0-6af1-44fa-a04c-563b471d4ada for instance 49803c3f-e096-4c19-a579-3224e6fe2809 on hv-cinder-85442 Aug 31 13:07:25.262161 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-93960191-b1a4-470c-85dc-798c8d04af85 req-8aaf9f86-db56-47ff-9ef3-2ee56c584e94 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032668 Aug 31 13:07:25.262951 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 357/730] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:07:33.443628 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-16d9b207-807b-499b-b4a6-4919e0ec6fa5 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Action: 'create', calling method: .version_select at 0x7f1951231790>, body: {"keypair": {"name": "tempest-keypair-809607317", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLNtJsCb/eNogoKLkXERCl2bTJPGDZLFBowoo9G1++9NAxxRcud60xlN08In5MMacwJ5tLfSvSlFbdPiWGuTbHwHVG89cosqXbcfSDadAQD1VNMPsR+sSXIcErlvRB3IJA=="}} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:07:33.449372 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:33.462860 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.quota [None req-16d9b207-807b-499b-b4a6-4919e0ec6fa5 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Getting quotas for project 8ed24957ab734181bca8793a33f63645. Resources: {'key_pairs'} {{(pid=120704) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 13:07:33.467970 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.quota [None req-16d9b207-807b-499b-b4a6-4919e0ec6fa5 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Getting quotas for user fb16ef11b3a9482ab5d40ff98ebd9cae and project 8ed24957ab734181bca8793a33f63645. Resources: {'key_pairs'} {{(pid=120704) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 13:07:33.491893 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-16d9b207-807b-499b-b4a6-4919e0ec6fa5 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.197334 Aug 31 13:07:33.492544 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 374/731] 10.222.0.58 () {62 vars in 1200 bytes} [Wed Aug 31 13:07:33 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 199 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 13:07:34.760187 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-bd2d11b9-1e9f-4534-9f1a-6181d80b7b13 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1544743465", "imageRef": "2aa55919-0f25-4e84-a2e1-f60acbe208b2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cfa73093-1e0e-4a6a-8e10-98c16a5ac11f"}], "security_groups": [{"name": "tempest-securitygroup--59674465"}], "key_name": "tempest-keypair-809607317", "user_data": "}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:07:34.768606 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:34.883302 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.network.neutron [None req-bd2d11b9-1e9f-4534-9f1a-6181d80b7b13 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] validate_networks() for [('cfa73093-1e0e-4a6a-8e10-98c16a5ac11f', None, None, None, None, None)] {{(pid=120705) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 13:07:35.249991 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:35.287568 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-bd2d11b9-1e9f-4534-9f1a-6181d80b7b13 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Flavor limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 13:07:35.288358 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-bd2d11b9-1e9f-4534-9f1a-6181d80b7b13 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Image limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 13:07:35.288864 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-bd2d11b9-1e9f-4534-9f1a-6181d80b7b13 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Flavor pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 13:07:35.289262 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-bd2d11b9-1e9f-4534-9f1a-6181d80b7b13 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Image pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 13:07:35.289841 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-bd2d11b9-1e9f-4534-9f1a-6181d80b7b13 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 13:07:35.298944 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bd2d11b9-1e9f-4534-9f1a-6181d80b7b13 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:35.299419 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bd2d11b9-1e9f-4534-9f1a-6181d80b7b13 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:35.299987 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bd2d11b9-1e9f-4534-9f1a-6181d80b7b13 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:35.300713 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bd2d11b9-1e9f-4534-9f1a-6181d80b7b13 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:35.301158 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bd2d11b9-1e9f-4534-9f1a-6181d80b7b13 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:35.301597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bd2d11b9-1e9f-4534-9f1a-6181d80b7b13 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:35.319216 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-bd2d11b9-1e9f-4534-9f1a-6181d80b7b13 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Getting quotas for project 8ed24957ab734181bca8793a33f63645. Resources: {'instances', 'ram', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 13:07:35.323137 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-bd2d11b9-1e9f-4534-9f1a-6181d80b7b13 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Getting quotas for user fb16ef11b3a9482ab5d40ff98ebd9cae and project 8ed24957ab734181bca8793a33f63645. Resources: {'instances', 'ram', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 13:07:35.334423 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-bd2d11b9-1e9f-4534-9f1a-6181d80b7b13 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Going to run 1 instances... {{(pid=120705) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 13:07:35.336843 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-bd2d11b9-1e9f-4534-9f1a-6181d80b7b13 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2aa55919-0f25-4e84-a2e1-f60acbe208b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120705) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 13:07:35.385919 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-bd2d11b9-1e9f-4534-9f1a-6181d80b7b13 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.631293 Aug 31 13:07:35.386472 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 358/732] 10.222.0.58 () {62 vars in 1188 bytes} [Wed Aug 31 13:07:34 2022] POST /compute/v2.1/servers => generated 400 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 13:07:35.394802 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:35.398810 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-634a70e6-fc4f-4894-87e7-395086bfc5da tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:35.399505 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-634a70e6-fc4f-4894-87e7-395086bfc5da tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:35.455234 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-634a70e6-fc4f-4894-87e7-395086bfc5da tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:35.465030 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-634a70e6-fc4f-4894-87e7-395086bfc5da tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:35.466886 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-634a70e6-fc4f-4894-87e7-395086bfc5da tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:35.468208 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-634a70e6-fc4f-4894-87e7-395086bfc5da tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1281 microversion: 2.20 time: 0.074577 Aug 31 13:07:35.469255 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 375/733] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:07:35 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:07:36.495695 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-d7dca02b-7d67-467f-bcd4-ff1cf2dd2fa3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:36.496416 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-d7dca02b-7d67-467f-bcd4-ff1cf2dd2fa3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:36.503110 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d7dca02b-7d67-467f-bcd4-ff1cf2dd2fa3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:36.503668 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d7dca02b-7d67-467f-bcd4-ff1cf2dd2fa3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:36.504183 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d7dca02b-7d67-467f-bcd4-ff1cf2dd2fa3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:36.504995 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d7dca02b-7d67-467f-bcd4-ff1cf2dd2fa3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:36.505499 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d7dca02b-7d67-467f-bcd4-ff1cf2dd2fa3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:36.505913 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d7dca02b-7d67-467f-bcd4-ff1cf2dd2fa3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:36.575530 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-d7dca02b-7d67-467f-bcd4-ff1cf2dd2fa3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:36.585297 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-d7dca02b-7d67-467f-bcd4-ff1cf2dd2fa3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:36.586727 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-d7dca02b-7d67-467f-bcd4-ff1cf2dd2fa3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:36.587851 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-d7dca02b-7d67-467f-bcd4-ff1cf2dd2fa3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1333 microversion: 2.20 time: 0.097063 Aug 31 13:07:36.588427 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 359/734] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:07:36 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1333 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:07:37.611238 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-f731e622-6e17-49fe-b292-e687f244391c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:37.611898 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-f731e622-6e17-49fe-b292-e687f244391c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:37.619030 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f731e622-6e17-49fe-b292-e687f244391c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:37.619627 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f731e622-6e17-49fe-b292-e687f244391c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:37.620076 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f731e622-6e17-49fe-b292-e687f244391c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:37.620774 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f731e622-6e17-49fe-b292-e687f244391c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:37.621324 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f731e622-6e17-49fe-b292-e687f244391c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:37.621745 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f731e622-6e17-49fe-b292-e687f244391c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:37.846094 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-f731e622-6e17-49fe-b292-e687f244391c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:37.855273 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-f731e622-6e17-49fe-b292-e687f244391c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:37.856781 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-f731e622-6e17-49fe-b292-e687f244391c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:37.857915 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-f731e622-6e17-49fe-b292-e687f244391c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1405 microversion: 2.20 time: 0.251034 Aug 31 13:07:37.858544 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 376/735] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:07:37 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1405 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:07:38.447381 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-98a7da34-6cb8-42c6-820f-32b9249d06ec req-5a9fa7e6-b150-491d-a111-d6a6a654efc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21c9e3cb-e5b1-428d-8405-ec33632c5f3d", "tag": "b32c3e63-7e7a-4bf8-bf81-80a7acf17f63"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:07:38.458606 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-98a7da34-6cb8-42c6-820f-32b9249d06ec req-5a9fa7e6-b150-491d-a111-d6a6a654efc6 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:38.459514 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-98a7da34-6cb8-42c6-820f-32b9249d06ec req-5a9fa7e6-b150-491d-a111-d6a6a654efc6 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:38.460237 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-98a7da34-6cb8-42c6-820f-32b9249d06ec req-5a9fa7e6-b150-491d-a111-d6a6a654efc6 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:38.471851 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-98a7da34-6cb8-42c6-820f-32b9249d06ec req-5a9fa7e6-b150-491d-a111-d6a6a654efc6 service nova] Creating event network-changed:b32c3e63-7e7a-4bf8-bf81-80a7acf17f63 for instance 21c9e3cb-e5b1-428d-8405-ec33632c5f3d on hv-cinder-85442 Aug 31 13:07:38.476821 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-98a7da34-6cb8-42c6-820f-32b9249d06ec req-5a9fa7e6-b150-491d-a111-d6a6a654efc6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033241 Aug 31 13:07:38.477433 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 360/736] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:07:38.881140 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-fd297939-6907-46f6-a0df-2d8fd0d4a31f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:38.881740 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-fd297939-6907-46f6-a0df-2d8fd0d4a31f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:38.889235 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fd297939-6907-46f6-a0df-2d8fd0d4a31f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:38.889840 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fd297939-6907-46f6-a0df-2d8fd0d4a31f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:38.890151 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fd297939-6907-46f6-a0df-2d8fd0d4a31f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:38.890801 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fd297939-6907-46f6-a0df-2d8fd0d4a31f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:38.891413 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fd297939-6907-46f6-a0df-2d8fd0d4a31f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:38.892069 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fd297939-6907-46f6-a0df-2d8fd0d4a31f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:39.058175 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-fd297939-6907-46f6-a0df-2d8fd0d4a31f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:39.067490 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-fd297939-6907-46f6-a0df-2d8fd0d4a31f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:39.068948 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-fd297939-6907-46f6-a0df-2d8fd0d4a31f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:39.070066 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-fd297939-6907-46f6-a0df-2d8fd0d4a31f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1405 microversion: 2.20 time: 0.193037 Aug 31 13:07:39.070623 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 377/737] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:07:38 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1405 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:07:40.093725 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-78a241c7-4a3a-4507-8473-47ff5b3c00dd tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:40.094264 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-78a241c7-4a3a-4507-8473-47ff5b3c00dd tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:40.101009 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-78a241c7-4a3a-4507-8473-47ff5b3c00dd tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:40.101477 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-78a241c7-4a3a-4507-8473-47ff5b3c00dd tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:40.101900 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-78a241c7-4a3a-4507-8473-47ff5b3c00dd tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:40.102578 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-78a241c7-4a3a-4507-8473-47ff5b3c00dd tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:40.103018 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-78a241c7-4a3a-4507-8473-47ff5b3c00dd tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:40.103430 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-78a241c7-4a3a-4507-8473-47ff5b3c00dd tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:40.235739 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-78a241c7-4a3a-4507-8473-47ff5b3c00dd tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:40.244042 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-78a241c7-4a3a-4507-8473-47ff5b3c00dd tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:40.245466 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-78a241c7-4a3a-4507-8473-47ff5b3c00dd tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:40.246567 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-78a241c7-4a3a-4507-8473-47ff5b3c00dd tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1405 microversion: 2.20 time: 0.157706 Aug 31 13:07:40.247121 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 361/738] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:07:40 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:07:41.273333 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-e5898d3a-5b4e-4331-9bd0-b3461342cdb3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:41.274321 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-e5898d3a-5b4e-4331-9bd0-b3461342cdb3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:41.284761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e5898d3a-5b4e-4331-9bd0-b3461342cdb3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:41.285223 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e5898d3a-5b4e-4331-9bd0-b3461342cdb3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:41.285704 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e5898d3a-5b4e-4331-9bd0-b3461342cdb3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:41.286391 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e5898d3a-5b4e-4331-9bd0-b3461342cdb3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:41.286871 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e5898d3a-5b4e-4331-9bd0-b3461342cdb3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:41.287291 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e5898d3a-5b4e-4331-9bd0-b3461342cdb3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:41.426799 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-e5898d3a-5b4e-4331-9bd0-b3461342cdb3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:41.435281 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-e5898d3a-5b4e-4331-9bd0-b3461342cdb3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:41.436792 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-e5898d3a-5b4e-4331-9bd0-b3461342cdb3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:41.437946 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-e5898d3a-5b4e-4331-9bd0-b3461342cdb3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1405 microversion: 2.20 time: 0.171195 Aug 31 13:07:41.438511 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 378/739] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:07:41 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1405 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:07:42.466508 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3473cfe5-f7c5-46a2-8b64-046eb809b31a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:42.467120 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-3473cfe5-f7c5-46a2-8b64-046eb809b31a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:42.473597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3473cfe5-f7c5-46a2-8b64-046eb809b31a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:42.474098 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3473cfe5-f7c5-46a2-8b64-046eb809b31a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:42.474507 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3473cfe5-f7c5-46a2-8b64-046eb809b31a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:42.475193 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3473cfe5-f7c5-46a2-8b64-046eb809b31a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:42.475637 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3473cfe5-f7c5-46a2-8b64-046eb809b31a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:42.476110 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3473cfe5-f7c5-46a2-8b64-046eb809b31a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:42.615668 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-3473cfe5-f7c5-46a2-8b64-046eb809b31a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:42.624178 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-3473cfe5-f7c5-46a2-8b64-046eb809b31a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:42.625716 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-3473cfe5-f7c5-46a2-8b64-046eb809b31a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:42.627034 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-3473cfe5-f7c5-46a2-8b64-046eb809b31a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1405 microversion: 2.20 time: 0.164546 Aug 31 13:07:42.634076 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 362/740] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:07:42 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1405 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:07:43.659144 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-3446763a-0697-481c-80ba-495696ed9eb3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:43.659704 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-3446763a-0697-481c-80ba-495696ed9eb3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:43.666778 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3446763a-0697-481c-80ba-495696ed9eb3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:43.667253 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3446763a-0697-481c-80ba-495696ed9eb3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:43.667679 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3446763a-0697-481c-80ba-495696ed9eb3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:43.668394 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3446763a-0697-481c-80ba-495696ed9eb3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:43.668838 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3446763a-0697-481c-80ba-495696ed9eb3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:43.669255 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3446763a-0697-481c-80ba-495696ed9eb3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:43.810053 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-3446763a-0697-481c-80ba-495696ed9eb3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:43.822680 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-3446763a-0697-481c-80ba-495696ed9eb3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:43.825070 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-3446763a-0697-481c-80ba-495696ed9eb3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:43.826838 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-3446763a-0697-481c-80ba-495696ed9eb3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1405 microversion: 2.20 time: 0.173925 Aug 31 13:07:43.827667 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 379/741] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:07:43 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1405 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:07:44.850724 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-d4f7cd1a-5fa8-4cc2-8ada-776d350b3677 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:44.851301 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-d4f7cd1a-5fa8-4cc2-8ada-776d350b3677 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:44.858108 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d4f7cd1a-5fa8-4cc2-8ada-776d350b3677 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:44.858588 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d4f7cd1a-5fa8-4cc2-8ada-776d350b3677 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:44.859109 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d4f7cd1a-5fa8-4cc2-8ada-776d350b3677 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:44.859796 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d4f7cd1a-5fa8-4cc2-8ada-776d350b3677 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:44.860425 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-123cb205-93e5-42af-87e2-1c3b9e2f4b0a req-8a9b25ce-ca70-4a5a-a1a2-66aff9002968 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21c9e3cb-e5b1-428d-8405-ec33632c5f3d", "name": "network-vif-plugged", "status": "completed", "tag": "b32c3e63-7e7a-4bf8-bf81-80a7acf17f63"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:07:44.860877 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d4f7cd1a-5fa8-4cc2-8ada-776d350b3677 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:44.861051 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d4f7cd1a-5fa8-4cc2-8ada-776d350b3677 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:44.872118 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-123cb205-93e5-42af-87e2-1c3b9e2f4b0a req-8a9b25ce-ca70-4a5a-a1a2-66aff9002968 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:44.873022 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-123cb205-93e5-42af-87e2-1c3b9e2f4b0a req-8a9b25ce-ca70-4a5a-a1a2-66aff9002968 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:44.873541 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-123cb205-93e5-42af-87e2-1c3b9e2f4b0a req-8a9b25ce-ca70-4a5a-a1a2-66aff9002968 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:44.886999 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-123cb205-93e5-42af-87e2-1c3b9e2f4b0a req-8a9b25ce-ca70-4a5a-a1a2-66aff9002968 service nova] Creating event network-vif-plugged:b32c3e63-7e7a-4bf8-bf81-80a7acf17f63 for instance 21c9e3cb-e5b1-428d-8405-ec33632c5f3d on hv-cinder-85442 Aug 31 13:07:44.892410 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-123cb205-93e5-42af-87e2-1c3b9e2f4b0a req-8a9b25ce-ca70-4a5a-a1a2-66aff9002968 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036109 Aug 31 13:07:44.893212 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 380/742] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:07:44.997380 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-d4f7cd1a-5fa8-4cc2-8ada-776d350b3677 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:45.006606 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-d4f7cd1a-5fa8-4cc2-8ada-776d350b3677 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:45.008101 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-d4f7cd1a-5fa8-4cc2-8ada-776d350b3677 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:45.009270 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-d4f7cd1a-5fa8-4cc2-8ada-776d350b3677 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1405 microversion: 2.20 time: 0.162754 Aug 31 13:07:45.009833 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 363/743] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:07:44 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:07:46.030739 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell0:SELECT=6 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:46.039939 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-82055b74-ba11-4f4b-b5ad-9f2c09c05081 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:46.041119 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-82055b74-ba11-4f4b-b5ad-9f2c09c05081 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:46.050907 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-82055b74-ba11-4f4b-b5ad-9f2c09c05081 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:46.051319 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-82055b74-ba11-4f4b-b5ad-9f2c09c05081 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:46.051742 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-82055b74-ba11-4f4b-b5ad-9f2c09c05081 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:46.052465 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-82055b74-ba11-4f4b-b5ad-9f2c09c05081 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:46.052910 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-82055b74-ba11-4f4b-b5ad-9f2c09c05081 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:46.053324 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-82055b74-ba11-4f4b-b5ad-9f2c09c05081 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:46.188116 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-82055b74-ba11-4f4b-b5ad-9f2c09c05081 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:46.196665 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-82055b74-ba11-4f4b-b5ad-9f2c09c05081 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:46.198103 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-82055b74-ba11-4f4b-b5ad-9f2c09c05081 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:46.199283 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-82055b74-ba11-4f4b-b5ad-9f2c09c05081 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1405 microversion: 2.20 time: 0.170330 Aug 31 13:07:46.199878 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 381/744] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:07:46 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:07:47.223071 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-9999b85c-3ff0-45f4-b2b9-64d4503122b8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:47.223682 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-9999b85c-3ff0-45f4-b2b9-64d4503122b8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:47.225664 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=2 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:47.226340 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=6 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:07:47.232645 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9999b85c-3ff0-45f4-b2b9-64d4503122b8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:47.233116 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9999b85c-3ff0-45f4-b2b9-64d4503122b8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:47.233545 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9999b85c-3ff0-45f4-b2b9-64d4503122b8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:47.234233 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9999b85c-3ff0-45f4-b2b9-64d4503122b8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:47.234688 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9999b85c-3ff0-45f4-b2b9-64d4503122b8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:47.235065 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9999b85c-3ff0-45f4-b2b9-64d4503122b8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:47.372540 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-9999b85c-3ff0-45f4-b2b9-64d4503122b8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:47.380625 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-9999b85c-3ff0-45f4-b2b9-64d4503122b8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:47.382049 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-9999b85c-3ff0-45f4-b2b9-64d4503122b8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:47.383188 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-9999b85c-3ff0-45f4-b2b9-64d4503122b8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1598 microversion: 2.20 time: 0.164982 Aug 31 13:07:47.383969 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 364/745] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:07:47 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1598 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:07:47.405532 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-f9a97f90-58c5-4692-b3a5-1cc97af1ca9d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:47.406585 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-f9a97f90-58c5-4692-b3a5-1cc97af1ca9d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:47.413167 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f9a97f90-58c5-4692-b3a5-1cc97af1ca9d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:47.413671 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f9a97f90-58c5-4692-b3a5-1cc97af1ca9d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:47.414099 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f9a97f90-58c5-4692-b3a5-1cc97af1ca9d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:47.414788 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f9a97f90-58c5-4692-b3a5-1cc97af1ca9d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:47.415223 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f9a97f90-58c5-4692-b3a5-1cc97af1ca9d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:47.415633 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f9a97f90-58c5-4692-b3a5-1cc97af1ca9d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:47.495585 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-f9a97f90-58c5-4692-b3a5-1cc97af1ca9d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.093946 Aug 31 13:07:47.496259 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 382/746] 10.222.0.58 () {60 vars in 1316 bytes} [Wed Aug 31 13:07:47 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:07:48.707245 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-87e60aba-5238-4438-97fd-234a934e43f6 req-87795740-a1e7-4933-bf44-e87b7f1990ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21c9e3cb-e5b1-428d-8405-ec33632c5f3d", "tag": "b32c3e63-7e7a-4bf8-bf81-80a7acf17f63"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:07:48.717225 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-87e60aba-5238-4438-97fd-234a934e43f6 req-87795740-a1e7-4933-bf44-e87b7f1990ba service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:48.717695 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-87e60aba-5238-4438-97fd-234a934e43f6 req-87795740-a1e7-4933-bf44-e87b7f1990ba service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:48.718112 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-87e60aba-5238-4438-97fd-234a934e43f6 req-87795740-a1e7-4933-bf44-e87b7f1990ba service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:48.731144 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-87e60aba-5238-4438-97fd-234a934e43f6 req-87795740-a1e7-4933-bf44-e87b7f1990ba service nova] Creating event network-changed:b32c3e63-7e7a-4bf8-bf81-80a7acf17f63 for instance 21c9e3cb-e5b1-428d-8405-ec33632c5f3d on hv-cinder-85442 Aug 31 13:07:48.736806 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-87e60aba-5238-4438-97fd-234a934e43f6 req-87795740-a1e7-4933-bf44-e87b7f1990ba service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033185 Aug 31 13:07:48.737472 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 365/747] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:07:51.306811 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-ebb0ff54-97d2-4480-a108-4865dee575a6 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:51.307317 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-ebb0ff54-97d2-4480-a108-4865dee575a6 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:51.309169 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-b9b22c23-4171-4663-9cfb-17bb441a10db req-9812bbe5-fd85-4d85-a0ff-70e3057a33d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e792077-8a21-48f8-8f65-ce1a4aae8c0a", "tag": "22506bf3-0225-4ad3-b8d6-55645f334201"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:07:51.313773 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ebb0ff54-97d2-4480-a108-4865dee575a6 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:51.314531 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ebb0ff54-97d2-4480-a108-4865dee575a6 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:51.314965 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ebb0ff54-97d2-4480-a108-4865dee575a6 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:51.315674 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ebb0ff54-97d2-4480-a108-4865dee575a6 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:51.316161 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ebb0ff54-97d2-4480-a108-4865dee575a6 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:51.316580 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ebb0ff54-97d2-4480-a108-4865dee575a6 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:51.319960 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-b9b22c23-4171-4663-9cfb-17bb441a10db req-9812bbe5-fd85-4d85-a0ff-70e3057a33d4 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:51.320694 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-b9b22c23-4171-4663-9cfb-17bb441a10db req-9812bbe5-fd85-4d85-a0ff-70e3057a33d4 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:51.321403 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-b9b22c23-4171-4663-9cfb-17bb441a10db req-9812bbe5-fd85-4d85-a0ff-70e3057a33d4 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:51.333433 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-b9b22c23-4171-4663-9cfb-17bb441a10db req-9812bbe5-fd85-4d85-a0ff-70e3057a33d4 service nova] Creating event network-changed:22506bf3-0225-4ad3-b8d6-55645f334201 for instance 9e792077-8a21-48f8-8f65-ce1a4aae8c0a on hv-cinder-85442 Aug 31 13:07:51.338963 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-b9b22c23-4171-4663-9cfb-17bb441a10db req-9812bbe5-fd85-4d85-a0ff-70e3057a33d4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034015 Aug 31 13:07:51.340591 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 366/748] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:07:51.344488 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-ebb0ff54-97d2-4480-a108-4865dee575a6 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Going to try to terminate instance {{(pid=120704) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 13:07:51.425277 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-ebb0ff54-97d2-4480-a108-4865dee575a6 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 204 len: 0 microversion: 2.1 time: 0.123066 Aug 31 13:07:51.425815 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 383/749] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 31 13:07:51 2022] DELETE /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:07:51.434718 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-54c0805e-2240-4e1f-9e32-5d77cc4c19a5 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:51.435426 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-54c0805e-2240-4e1f-9e32-5d77cc4c19a5 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:51.442262 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-54c0805e-2240-4e1f-9e32-5d77cc4c19a5 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:51.442753 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-54c0805e-2240-4e1f-9e32-5d77cc4c19a5 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:51.443190 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-54c0805e-2240-4e1f-9e32-5d77cc4c19a5 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:51.443933 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-54c0805e-2240-4e1f-9e32-5d77cc4c19a5 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:51.444385 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-54c0805e-2240-4e1f-9e32-5d77cc4c19a5 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:51.444810 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-54c0805e-2240-4e1f-9e32-5d77cc4c19a5 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:51.584544 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-54c0805e-2240-4e1f-9e32-5d77cc4c19a5 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:51.592867 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-54c0805e-2240-4e1f-9e32-5d77cc4c19a5 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1568 microversion: 2.1 time: 0.162420 Aug 31 13:07:51.593688 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 367/750] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:07:51 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:07:52.620402 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-c070f77c-0464-4e30-a5b1-cca1462d31cd tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:52.621137 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-c070f77c-0464-4e30-a5b1-cca1462d31cd tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:52.630171 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c070f77c-0464-4e30-a5b1-cca1462d31cd tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:52.630688 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c070f77c-0464-4e30-a5b1-cca1462d31cd tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:52.631130 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c070f77c-0464-4e30-a5b1-cca1462d31cd tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:52.631896 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c070f77c-0464-4e30-a5b1-cca1462d31cd tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:52.632383 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c070f77c-0464-4e30-a5b1-cca1462d31cd tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:52.632833 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c070f77c-0464-4e30-a5b1-cca1462d31cd tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:52.773191 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-c070f77c-0464-4e30-a5b1-cca1462d31cd tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:52.781814 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-c070f77c-0464-4e30-a5b1-cca1462d31cd tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1568 microversion: 2.1 time: 0.168608 Aug 31 13:07:52.782413 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 384/751] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:07:52 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:07:53.805676 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-ecebaa23-9eb4-4a0a-ab32-3a4f2438fdf3 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:53.806293 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-ecebaa23-9eb4-4a0a-ab32-3a4f2438fdf3 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:53.812928 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ecebaa23-9eb4-4a0a-ab32-3a4f2438fdf3 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:53.813402 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ecebaa23-9eb4-4a0a-ab32-3a4f2438fdf3 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:53.813920 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ecebaa23-9eb4-4a0a-ab32-3a4f2438fdf3 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:53.814623 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ecebaa23-9eb4-4a0a-ab32-3a4f2438fdf3 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:53.815102 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ecebaa23-9eb4-4a0a-ab32-3a4f2438fdf3 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:53.815521 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ecebaa23-9eb4-4a0a-ab32-3a4f2438fdf3 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:53.949916 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-ecebaa23-9eb4-4a0a-ab32-3a4f2438fdf3 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:53.957883 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-ecebaa23-9eb4-4a0a-ab32-3a4f2438fdf3 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1449 microversion: 2.1 time: 0.157144 Aug 31 13:07:53.958679 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 368/752] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:07:53 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:07:54.138495 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-46b9a851-2b93-4f33-a322-af3dc182c84b req-5f778ecc-482d-4d09-b734-4ffd36027d27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e792077-8a21-48f8-8f65-ce1a4aae8c0a", "name": "network-vif-deleted", "tag": "22506bf3-0225-4ad3-b8d6-55645f334201"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:07:54.149941 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-46b9a851-2b93-4f33-a322-af3dc182c84b req-5f778ecc-482d-4d09-b734-4ffd36027d27 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:54.150333 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-46b9a851-2b93-4f33-a322-af3dc182c84b req-5f778ecc-482d-4d09-b734-4ffd36027d27 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:54.150785 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-46b9a851-2b93-4f33-a322-af3dc182c84b req-5f778ecc-482d-4d09-b734-4ffd36027d27 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:54.165319 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-46b9a851-2b93-4f33-a322-af3dc182c84b req-5f778ecc-482d-4d09-b734-4ffd36027d27 service nova] Creating event network-vif-deleted:22506bf3-0225-4ad3-b8d6-55645f334201 for instance 9e792077-8a21-48f8-8f65-ce1a4aae8c0a on hv-cinder-85442 Aug 31 13:07:54.171069 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-46b9a851-2b93-4f33-a322-af3dc182c84b req-5f778ecc-482d-4d09-b734-4ffd36027d27 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036411 Aug 31 13:07:54.171662 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 385/753] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:07:54.978885 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-70d4954d-05a2-492b-8bbe-5fe6934d91e0 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:54.979422 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-70d4954d-05a2-492b-8bbe-5fe6934d91e0 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:54.986144 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-70d4954d-05a2-492b-8bbe-5fe6934d91e0 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:54.986678 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-70d4954d-05a2-492b-8bbe-5fe6934d91e0 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:54.987178 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-70d4954d-05a2-492b-8bbe-5fe6934d91e0 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:54.988074 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-70d4954d-05a2-492b-8bbe-5fe6934d91e0 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:54.988616 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-70d4954d-05a2-492b-8bbe-5fe6934d91e0 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:54.989054 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-70d4954d-05a2-492b-8bbe-5fe6934d91e0 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:55.021552 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-70d4954d-05a2-492b-8bbe-5fe6934d91e0 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:55.022024 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-70d4954d-05a2-492b-8bbe-5fe6934d91e0 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:55.022556 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-70d4954d-05a2-492b-8bbe-5fe6934d91e0 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:55.023013 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.objects.instance [None req-70d4954d-05a2-492b-8bbe-5fe6934d91e0 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lazy-loading 'fault' on Instance uuid 9e792077-8a21-48f8-8f65-ce1a4aae8c0a {{(pid=120705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 13:07:55.064494 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-70d4954d-05a2-492b-8bbe-5fe6934d91e0 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a961ae2bcbe24018befc9b9a9e6d288e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3859db006a384cd9b5ba39ca7e6fb922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:07:55.072444 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-70d4954d-05a2-492b-8bbe-5fe6934d91e0 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 200 len: 1224 microversion: 2.1 time: 0.097698 Aug 31 13:07:55.073061 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 369/754] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:07:54 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:07:56.098805 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-5c8b4529-378e-43a0-a561-e9d41b2932ad tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:56.099500 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-5c8b4529-378e-43a0-a561-e9d41b2932ad tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] [instance: 9e792077-8a21-48f8-8f65-ce1a4aae8c0a] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:07:56.107161 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5c8b4529-378e-43a0-a561-e9d41b2932ad tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:56.107724 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5c8b4529-378e-43a0-a561-e9d41b2932ad tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:56.108267 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5c8b4529-378e-43a0-a561-e9d41b2932ad tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:56.109075 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5c8b4529-378e-43a0-a561-e9d41b2932ad tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:07:56.109599 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5c8b4529-378e-43a0-a561-e9d41b2932ad tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:07:56.110092 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5c8b4529-378e-43a0-a561-e9d41b2932ad tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:07:56.126589 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.wsgi [None req-5c8b4529-378e-43a0-a561-e9d41b2932ad tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] HTTP exception thrown: Instance 9e792077-8a21-48f8-8f65-ce1a4aae8c0a could not be found. Aug 31 13:07:56.128557 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-5c8b4529-378e-43a0-a561-e9d41b2932ad tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Request method failure captured: Aug 31 13:07:56.128557 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: request: GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a HTTP/1.1 Aug 31 13:07:56.128557 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept: application/json Aug 31 13:07:56.128557 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept-Encoding: identity Aug 31 13:07:56.128557 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Connection: close Aug 31 13:07:56.128557 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Length: 0 Aug 31 13:07:56.128557 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Type: application/json Aug 31 13:07:56.128557 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Host: 10.222.0.58 Aug 31 13:07:56.128557 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Openstack-System-Scope: None Aug 31 13:07:56.128557 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: User-Agent: python-urllib3/1.26.12 Aug 31 13:07:56.128557 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Auth-Token: gAAAAABjD1tMRRN4USUnDFvO3hgS1fnEdPevV88o7DyZvstgId7cLSRAitFcr-wU4y2ECxRv1BfX4s36re1g_8GGUM9FfaI5XCMyMl_4NEvxvyW_UgsIa0oVpWR-jhDmzsH2rzGXCZDkHotn7IBspSJGHMh2iVKIi2as_oos19EEmKP9zvCH1QU Aug 31 13:07:56.128557 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Id: None Aug 31 13:07:56.128557 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Name: None Aug 31 13:07:56.128557 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Identity-Status: Confirmed Aug 31 13:07:56.128557 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Is-Admin-Project: True Aug 31 13:07:56.128557 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Id: default Aug 31 13:07:56.128557 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Name: Default Aug 31 13:07:56.128557 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Id: 3859db006a384cd9b5ba39ca7e6fb922 Aug 31 13:07:56.128557 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Name: tempest-TestShelveInstance-204973805 Aug 31 13:07:56.128557 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Role: member,reader Aug 31 13:07:56.128557 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Roles: member,reader Aug 31 13:07:56.130118 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3859db006a384cd9b5ba39ca7e6fb922"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3859db006a384cd9b5ba39ca7e6fb922"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3859db006a384cd9b5ba39ca7e6fb922"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3859db006a384cd9b5ba39ca7e6fb922"}]}] Aug 31 13:07:56.130118 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant: tempest-TestShelveInstance-204973805 Aug 31 13:07:56.130118 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Id: 3859db006a384cd9b5ba39ca7e6fb922 Aug 31 13:07:56.130118 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Name: tempest-TestShelveInstance-204973805 Aug 31 13:07:56.130118 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User: tempest-TestShelveInstance-204973805-project Aug 31 13:07:56.130118 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Id: default Aug 31 13:07:56.130118 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Name: Default Aug 31 13:07:56.130118 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Id: a961ae2bcbe24018befc9b9a9e6d288e Aug 31 13:07:56.130118 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Name: tempest-TestShelveInstance-204973805-project Aug 31 13:07:56.130118 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: method: > Aug 31 13:07:56.130118 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: exception: Instance 9e792077-8a21-48f8-8f65-ce1a4aae8c0a could not be found. Aug 31 13:07:56.130118 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: action_args: {'id': '9e792077-8a21-48f8-8f65-ce1a4aae8c0a'} Aug 31 13:07:56.130991 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:07:56.130991 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:07:56.130991 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 13:07:56.130991 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 13:07:56.130991 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 13:07:56.130991 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 13:07:56.130991 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 13:07:56.130991 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 13:07:56.130991 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 13:07:56.130991 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 13:07:56.130991 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e792077-8a21-48f8-8f65-ce1a4aae8c0a could not be found. Aug 31 13:07:56.130991 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:07:56.130991 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:07:56.130991 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:07:56.130991 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:07:56.130991 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:07:56.130991 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:07:56.130991 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:07:56.130991 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:07:56.130991 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:07:56.132515 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:07:56.132515 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 13:07:56.132515 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 13:07:56.132515 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 13:07:56.132515 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 13:07:56.132515 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 13:07:56.132515 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 13:07:56.132515 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e792077-8a21-48f8-8f65-ce1a4aae8c0a could not be found. Aug 31 13:07:56.132515 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:07:56.132515 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:07:56.132515 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:07:56.132515 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:07:56.132515 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:07:56.132515 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:07:56.132515 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:07:56.132515 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:07:56.132515 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e792077-8a21-48f8-8f65-ce1a4aae8c0a could not be found. Aug 31 13:07:56.132515 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:07:56.134109 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-5c8b4529-378e-43a0-a561-e9d41b2932ad tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Returning 404 to user: Instance 9e792077-8a21-48f8-8f65-ce1a4aae8c0a could not be found. {{(pid=120704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:07:56.134109 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-5c8b4529-378e-43a0-a561-e9d41b2932ad tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a" status: 404 len: 111 microversion: 2.1 time: 0.038662 Aug 31 13:07:56.134109 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 386/755] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:07:56 2022] GET /compute/v2.1/servers/9e792077-8a21-48f8-8f65-ce1a4aae8c0a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:07:56.304555 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-4b289ec2-b3e5-4e80-a83e-db993a357955 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] Calling method '.version_select at 0x7f19512961f0>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:07:56.324793 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-4b289ec2-b3e5-4e80-a83e-db993a357955 tempest-TestShelveInstance-204973805 tempest-TestShelveInstance-204973805-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-602751871" status: 202 len: 0 microversion: 2.1 time: 0.025248 Aug 31 13:07:56.325349 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 370/756] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 31 13:07:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-602751871 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:08:09.458186 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-9732ef4c-0fda-430c-88da-8d67ddd3dc75 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:08:09.459176 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-9732ef4c-0fda-430c-88da-8d67ddd3dc75 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 57462145-0049-4cce-87cf-698a1ebbbee3] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:08:09.463875 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:08:09.465251 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:08:09.475965 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9732ef4c-0fda-430c-88da-8d67ddd3dc75 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:09.476490 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9732ef4c-0fda-430c-88da-8d67ddd3dc75 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:09.476912 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9732ef4c-0fda-430c-88da-8d67ddd3dc75 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:09.477599 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9732ef4c-0fda-430c-88da-8d67ddd3dc75 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:09.478038 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9732ef4c-0fda-430c-88da-8d67ddd3dc75 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:09.478444 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9732ef4c-0fda-430c-88da-8d67ddd3dc75 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:09.504928 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-9732ef4c-0fda-430c-88da-8d67ddd3dc75 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3/ips" status: 200 len: 150 microversion: 2.1 time: 0.053272 Aug 31 13:08:09.505496 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 387/757] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 31 13:08:09 2022] GET /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3/ips => generated 150 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:08:10.858817 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=58 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:08:10.859574 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:08:10.863951 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-73fbd3eb-7d3d-4d15-9e46-1bd1c7c6ee25 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a9f9401-ea10-4cb6-b9cd-849e5665ea9b"}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:08:10.866401 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-73fbd3eb-7d3d-4d15-9e46-1bd1c7c6ee25 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 57462145-0049-4cce-87cf-698a1ebbbee3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:08:10.875315 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-73fbd3eb-7d3d-4d15-9e46-1bd1c7c6ee25 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:10.875892 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-73fbd3eb-7d3d-4d15-9e46-1bd1c7c6ee25 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:10.876346 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-73fbd3eb-7d3d-4d15-9e46-1bd1c7c6ee25 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:10.877025 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-73fbd3eb-7d3d-4d15-9e46-1bd1c7c6ee25 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:10.877469 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-73fbd3eb-7d3d-4d15-9e46-1bd1c7c6ee25 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:10.877891 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-73fbd3eb-7d3d-4d15-9e46-1bd1c7c6ee25 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:11.247856 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-73fbd3eb-7d3d-4d15-9e46-1bd1c7c6ee25 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "POST /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.390765 Aug 31 13:08:11.249783 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 371/758] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 31 13:08:10 2022] POST /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3/os-volume_attachments => generated 194 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:08:18.846105 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-4e55afd4-55c1-4c85-9837-883faf990a6d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a9f9401-ea10-4cb6-b9cd-849e5665ea9b"}} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:08:18.848458 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-4e55afd4-55c1-4c85-9837-883faf990a6d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 57462145-0049-4cce-87cf-698a1ebbbee3] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:08:18.855263 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4e55afd4-55c1-4c85-9837-883faf990a6d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:18.855741 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4e55afd4-55c1-4c85-9837-883faf990a6d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:18.856207 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4e55afd4-55c1-4c85-9837-883faf990a6d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:18.856898 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4e55afd4-55c1-4c85-9837-883faf990a6d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:18.857339 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4e55afd4-55c1-4c85-9837-883faf990a6d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:18.857753 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4e55afd4-55c1-4c85-9837-883faf990a6d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:18.948995 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.wsgi [None req-4e55afd4-55c1-4c85-9837-883faf990a6d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] HTTP exception thrown: Invalid volume: volume 2a9f9401-ea10-4cb6-b9cd-849e5665ea9b is already attached to instances: 57462145-0049-4cce-87cf-698a1ebbbee3 Aug 31 13:08:18.950583 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-4e55afd4-55c1-4c85-9837-883faf990a6d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Request method failure captured: Aug 31 13:08:18.950583 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: request: POST /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3/os-volume_attachments HTTP/1.1 Aug 31 13:08:18.950583 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept: application/json Aug 31 13:08:18.950583 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept-Encoding: identity Aug 31 13:08:18.950583 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Connection: close Aug 31 13:08:18.950583 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Length: 74 Aug 31 13:08:18.950583 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Type: application/json Aug 31 13:08:18.950583 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Host: 10.222.0.58 Aug 31 13:08:18.950583 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Openstack-System-Scope: None Aug 31 13:08:18.950583 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: User-Agent: python-urllib3/1.26.12 Aug 31 13:08:18.950583 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Auth-Token: gAAAAABjD1uCNSnUQPMlQgFT2jq-eB19r7xLb94uzxGnoJXWTepSWTo7UQTZU86dPbIoFZ8qqdn2aU_O4yRfHOsmgtmeK9yuhxtC117CeRP8ROwyQq4z33BXiou8fAPjfT5vF29_iKZcD17NL5FwHgpz6cSqA2AiwZ_XLORdaExhfMVopvwp8pU Aug 31 13:08:18.950583 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Id: None Aug 31 13:08:18.950583 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Name: None Aug 31 13:08:18.950583 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Identity-Status: Confirmed Aug 31 13:08:18.950583 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Is-Admin-Project: True Aug 31 13:08:18.950583 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Id: default Aug 31 13:08:18.950583 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Name: Default Aug 31 13:08:18.950583 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Id: fdf85a7b31004baf848842ad2f74cbf0 Aug 31 13:08:18.950583 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Name: tempest-AttachVolumeNegativeTest-2039526226 Aug 31 13:08:18.950583 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Role: member,reader Aug 31 13:08:18.950583 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Roles: member,reader Aug 31 13:08:18.952200 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fdf85a7b31004baf848842ad2f74cbf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fdf85a7b31004baf848842ad2f74cbf0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fdf85a7b31004baf848842ad2f74cbf0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fdf85a7b31004baf848842ad2f74cbf0"}]}] Aug 31 13:08:18.952200 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant: tempest-AttachVolumeNegativeTest-2039526226 Aug 31 13:08:18.952200 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Id: fdf85a7b31004baf848842ad2f74cbf0 Aug 31 13:08:18.952200 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2039526226 Aug 31 13:08:18.952200 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User: tempest-AttachVolumeNegativeTest-2039526226-project Aug 31 13:08:18.952200 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Id: default Aug 31 13:08:18.952200 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Name: Default Aug 31 13:08:18.952200 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Id: ac2a50988be24e20be034777225d8106 Aug 31 13:08:18.952200 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Name: tempest-AttachVolumeNegativeTest-2039526226-project Aug 31 13:08:18.952200 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Aug 31 13:08:18.952200 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: {"volumeAttachment": {"volumeId": "2a9f9401-ea10-4cb6-b9cd-849e5665ea9b"}} Aug 31 13:08:18.952200 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: method: > Aug 31 13:08:18.953139 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: exception: Invalid volume: volume 2a9f9401-ea10-4cb6-b9cd-849e5665ea9b is already attached to instances: 57462145-0049-4cce-87cf-698a1ebbbee3 Aug 31 13:08:18.953139 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: action_args: {'server_id': '57462145-0049-4cce-87cf-698a1ebbbee3', 'body': {'volumeAttachment': {'volumeId': '2a9f9401-ea10-4cb6-b9cd-849e5665ea9b'}}} Aug 31 13:08:18.953139 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:08:18.953139 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:08:18.953139 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 13:08:18.953139 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 13:08:18.953139 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 13:08:18.953139 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 13:08:18.953139 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 13:08:18.953139 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 13:08:18.953139 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 31 13:08:18.953139 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 31 13:08:18.953139 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 31 13:08:18.953139 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 31 13:08:18.953139 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2a9f9401-ea10-4cb6-b9cd-849e5665ea9b is already attached to instances: 57462145-0049-4cce-87cf-698a1ebbbee3 Aug 31 13:08:18.953139 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:08:18.953139 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:08:18.953139 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:08:18.953139 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:08:18.954575 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:08:18.954575 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:08:18.954575 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:08:18.954575 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:08:18.954575 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:08:18.954575 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:08:18.954575 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 13:08:18.954575 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 13:08:18.954575 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 13:08:18.954575 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 13:08:18.954575 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 13:08:18.954575 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 13:08:18.954575 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 31 13:08:18.954575 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 13:08:18.954575 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2a9f9401-ea10-4cb6-b9cd-849e5665ea9b is already attached to instances: 57462145-0049-4cce-87cf-698a1ebbbee3 Aug 31 13:08:18.954575 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:08:18.954575 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:08:18.954575 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:08:18.954575 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:08:18.954575 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:08:18.956170 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:08:18.956170 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:08:18.956170 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:08:18.956170 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2a9f9401-ea10-4cb6-b9cd-849e5665ea9b is already attached to instances: 57462145-0049-4cce-87cf-698a1ebbbee3 Aug 31 13:08:18.956170 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:08:18.956170 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-4e55afd4-55c1-4c85-9837-883faf990a6d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Returning 400 to user: Invalid volume: volume 2a9f9401-ea10-4cb6-b9cd-849e5665ea9b is already attached to instances: 57462145-0049-4cce-87cf-698a1ebbbee3 {{(pid=120704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:08:18.956170 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-4e55afd4-55c1-4c85-9837-883faf990a6d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "POST /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.109938 Aug 31 13:08:18.956170 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 388/759] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 31 13:08:18 2022] POST /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3/os-volume_attachments => generated 174 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 13:08:19.020270 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-a5087946-0d16-44de-81a7-1cf8e4036489 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:08:19.020803 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-a5087946-0d16-44de-81a7-1cf8e4036489 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 57462145-0049-4cce-87cf-698a1ebbbee3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:08:19.027726 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a5087946-0d16-44de-81a7-1cf8e4036489 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:19.028242 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a5087946-0d16-44de-81a7-1cf8e4036489 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:19.028678 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a5087946-0d16-44de-81a7-1cf8e4036489 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:19.029376 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a5087946-0d16-44de-81a7-1cf8e4036489 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:19.029826 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a5087946-0d16-44de-81a7-1cf8e4036489 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:19.030554 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a5087946-0d16-44de-81a7-1cf8e4036489 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:19.111847 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.objects.instance [None req-a5087946-0d16-44de-81a7-1cf8e4036489 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lazy-loading 'services' on Instance uuid 57462145-0049-4cce-87cf-698a1ebbbee3 {{(pid=120705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 13:08:19.187088 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-a5087946-0d16-44de-81a7-1cf8e4036489 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "DELETE /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3/os-volume_attachments/2a9f9401-ea10-4cb6-b9cd-849e5665ea9b" status: 202 len: 0 microversion: 2.1 time: 0.171548 Aug 31 13:08:19.187708 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 372/760] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 31 13:08:19 2022] DELETE /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3/os-volume_attachments/2a9f9401-ea10-4cb6-b9cd-849e5665ea9b => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:08:19.196400 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-b834ca8f-0c92-4abc-b74b-098b713cab5e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:08:19.198613 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-b834ca8f-0c92-4abc-b74b-098b713cab5e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 57462145-0049-4cce-87cf-698a1ebbbee3] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:08:19.205301 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b834ca8f-0c92-4abc-b74b-098b713cab5e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:19.205771 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b834ca8f-0c92-4abc-b74b-098b713cab5e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:19.206200 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b834ca8f-0c92-4abc-b74b-098b713cab5e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:19.206880 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b834ca8f-0c92-4abc-b74b-098b713cab5e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:19.207320 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b834ca8f-0c92-4abc-b74b-098b713cab5e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:19.207744 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b834ca8f-0c92-4abc-b74b-098b713cab5e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:19.238734 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-b834ca8f-0c92-4abc-b74b-098b713cab5e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046354 Aug 31 13:08:19.239294 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 389/761] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 31 13:08:19 2022] GET /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:08:20.252610 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-cc6b1b33-f9fa-4c1f-a2da-b2fc5c14f711 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:08:20.254992 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-cc6b1b33-f9fa-4c1f-a2da-b2fc5c14f711 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 57462145-0049-4cce-87cf-698a1ebbbee3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:08:20.261421 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cc6b1b33-f9fa-4c1f-a2da-b2fc5c14f711 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:20.261898 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cc6b1b33-f9fa-4c1f-a2da-b2fc5c14f711 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:20.262330 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cc6b1b33-f9fa-4c1f-a2da-b2fc5c14f711 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:20.263011 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cc6b1b33-f9fa-4c1f-a2da-b2fc5c14f711 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:20.263455 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cc6b1b33-f9fa-4c1f-a2da-b2fc5c14f711 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:20.263891 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cc6b1b33-f9fa-4c1f-a2da-b2fc5c14f711 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:20.293340 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-cc6b1b33-f9fa-4c1f-a2da-b2fc5c14f711 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045697 Aug 31 13:08:20.293907 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 373/762] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 31 13:08:20 2022] GET /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 13:08:20.354148 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-b41119a1-8247-4309-87f4-ac4c4df7facd tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:08:20.354663 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-b41119a1-8247-4309-87f4-ac4c4df7facd tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 57462145-0049-4cce-87cf-698a1ebbbee3] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:08:20.361292 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b41119a1-8247-4309-87f4-ac4c4df7facd tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:20.361759 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b41119a1-8247-4309-87f4-ac4c4df7facd tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:20.362186 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b41119a1-8247-4309-87f4-ac4c4df7facd tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:20.362855 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b41119a1-8247-4309-87f4-ac4c4df7facd tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:20.363295 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b41119a1-8247-4309-87f4-ac4c4df7facd tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:20.363698 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b41119a1-8247-4309-87f4-ac4c4df7facd tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:20.389310 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-b41119a1-8247-4309-87f4-ac4c4df7facd tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 57462145-0049-4cce-87cf-698a1ebbbee3] Going to try to terminate instance {{(pid=120704) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 13:08:20.470078 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-b41119a1-8247-4309-87f4-ac4c4df7facd tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "DELETE /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3" status: 204 len: 0 microversion: 2.1 time: 0.119676 Aug 31 13:08:20.470672 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 390/763] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 31 13:08:20 2022] DELETE /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:08:20.479534 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3c978d36-3b15-4af2-9299-b5360dd41730 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:08:20.480173 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-3c978d36-3b15-4af2-9299-b5360dd41730 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 57462145-0049-4cce-87cf-698a1ebbbee3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:08:20.486107 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3c978d36-3b15-4af2-9299-b5360dd41730 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:20.486575 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3c978d36-3b15-4af2-9299-b5360dd41730 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:20.486997 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3c978d36-3b15-4af2-9299-b5360dd41730 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:20.487667 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3c978d36-3b15-4af2-9299-b5360dd41730 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:20.488142 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3c978d36-3b15-4af2-9299-b5360dd41730 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:20.488552 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3c978d36-3b15-4af2-9299-b5360dd41730 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:20.632722 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-3c978d36-3b15-4af2-9299-b5360dd41730 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:08:20.640913 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-3c978d36-3b15-4af2-9299-b5360dd41730 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3" status: 200 len: 1681 microversion: 2.1 time: 0.165803 Aug 31 13:08:20.641412 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 374/764] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:08:20 2022] GET /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:08:21.666108 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-117609e9-6ec9-49b1-a9c5-22d34412b8a4 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:08:21.666724 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-117609e9-6ec9-49b1-a9c5-22d34412b8a4 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 57462145-0049-4cce-87cf-698a1ebbbee3] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:08:21.677215 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-117609e9-6ec9-49b1-a9c5-22d34412b8a4 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:21.677902 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-117609e9-6ec9-49b1-a9c5-22d34412b8a4 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:21.678565 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-117609e9-6ec9-49b1-a9c5-22d34412b8a4 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:21.679653 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-117609e9-6ec9-49b1-a9c5-22d34412b8a4 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:21.680521 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-117609e9-6ec9-49b1-a9c5-22d34412b8a4 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:21.681098 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-117609e9-6ec9-49b1-a9c5-22d34412b8a4 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:21.820967 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-117609e9-6ec9-49b1-a9c5-22d34412b8a4 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:08:21.829374 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-117609e9-6ec9-49b1-a9c5-22d34412b8a4 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3" status: 200 len: 1681 microversion: 2.1 time: 0.170293 Aug 31 13:08:21.829942 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 391/765] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:08:21 2022] GET /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:08:22.850822 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-ddba57b8-c86b-4f42-9193-0def8a820d46 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:08:22.851369 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-ddba57b8-c86b-4f42-9193-0def8a820d46 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 57462145-0049-4cce-87cf-698a1ebbbee3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:08:22.858293 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ddba57b8-c86b-4f42-9193-0def8a820d46 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:22.858760 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ddba57b8-c86b-4f42-9193-0def8a820d46 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:22.859185 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ddba57b8-c86b-4f42-9193-0def8a820d46 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:22.859850 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ddba57b8-c86b-4f42-9193-0def8a820d46 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:22.860326 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ddba57b8-c86b-4f42-9193-0def8a820d46 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:22.860737 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ddba57b8-c86b-4f42-9193-0def8a820d46 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:22.993817 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-ddba57b8-c86b-4f42-9193-0def8a820d46 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:08:23.003289 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-ddba57b8-c86b-4f42-9193-0def8a820d46 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3" status: 200 len: 1681 microversion: 2.1 time: 0.156349 Aug 31 13:08:23.003885 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 375/766] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:08:22 2022] GET /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:08:23.550909 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-f04623d8-05ca-4a05-9aca-48ebe92d7938 req-c3a79d9d-83b1-4773-87a1-0c1125b739f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57462145-0049-4cce-87cf-698a1ebbbee3", "name": "network-vif-deleted", "tag": "62b64a92-6618-4376-a7cb-adbe0fba009a"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:08:23.562458 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-f04623d8-05ca-4a05-9aca-48ebe92d7938 req-c3a79d9d-83b1-4773-87a1-0c1125b739f0 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:23.562925 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-f04623d8-05ca-4a05-9aca-48ebe92d7938 req-c3a79d9d-83b1-4773-87a1-0c1125b739f0 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:23.563332 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-f04623d8-05ca-4a05-9aca-48ebe92d7938 req-c3a79d9d-83b1-4773-87a1-0c1125b739f0 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:23.579757 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-f04623d8-05ca-4a05-9aca-48ebe92d7938 req-c3a79d9d-83b1-4773-87a1-0c1125b739f0 service nova] Creating event network-vif-deleted:62b64a92-6618-4376-a7cb-adbe0fba009a for instance 57462145-0049-4cce-87cf-698a1ebbbee3 on hv-cinder-85442 Aug 31 13:08:23.586125 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-f04623d8-05ca-4a05-9aca-48ebe92d7938 req-c3a79d9d-83b1-4773-87a1-0c1125b739f0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039020 Aug 31 13:08:23.586769 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 392/767] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:08:24.024499 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-96a444cd-e653-4abe-9631-f476a30b638c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:08:24.025164 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-96a444cd-e653-4abe-9631-f476a30b638c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 57462145-0049-4cce-87cf-698a1ebbbee3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:08:24.032615 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-96a444cd-e653-4abe-9631-f476a30b638c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:24.033112 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-96a444cd-e653-4abe-9631-f476a30b638c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:24.033547 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-96a444cd-e653-4abe-9631-f476a30b638c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:24.034250 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-96a444cd-e653-4abe-9631-f476a30b638c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:24.034699 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-96a444cd-e653-4abe-9631-f476a30b638c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:24.035119 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-96a444cd-e653-4abe-9631-f476a30b638c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:24.069183 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-96a444cd-e653-4abe-9631-f476a30b638c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:24.069658 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-96a444cd-e653-4abe-9631-f476a30b638c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:24.070113 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-96a444cd-e653-4abe-9631-f476a30b638c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:24.070538 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.objects.instance [None req-96a444cd-e653-4abe-9631-f476a30b638c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lazy-loading 'fault' on Instance uuid 57462145-0049-4cce-87cf-698a1ebbbee3 {{(pid=120705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 13:08:24.129194 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-96a444cd-e653-4abe-9631-f476a30b638c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:08:24.137132 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-96a444cd-e653-4abe-9631-f476a30b638c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3" status: 200 len: 1330 microversion: 2.1 time: 0.116593 Aug 31 13:08:24.137914 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 376/768] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:08:24 2022] GET /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3 => generated 1330 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:08:25.163514 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-6b8c7879-d970-44f8-ae9e-68f80343b199 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:08:25.164676 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-6b8c7879-d970-44f8-ae9e-68f80343b199 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 57462145-0049-4cce-87cf-698a1ebbbee3] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:08:25.172078 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6b8c7879-d970-44f8-ae9e-68f80343b199 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:25.172547 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6b8c7879-d970-44f8-ae9e-68f80343b199 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:25.172968 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6b8c7879-d970-44f8-ae9e-68f80343b199 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:25.173648 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6b8c7879-d970-44f8-ae9e-68f80343b199 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:25.174074 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6b8c7879-d970-44f8-ae9e-68f80343b199 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:25.174483 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6b8c7879-d970-44f8-ae9e-68f80343b199 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:25.187972 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.wsgi [None req-6b8c7879-d970-44f8-ae9e-68f80343b199 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] HTTP exception thrown: Instance 57462145-0049-4cce-87cf-698a1ebbbee3 could not be found. Aug 31 13:08:25.189562 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-6b8c7879-d970-44f8-ae9e-68f80343b199 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Request method failure captured: Aug 31 13:08:25.189562 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: request: GET /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3 HTTP/1.1 Aug 31 13:08:25.189562 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept: application/json Aug 31 13:08:25.189562 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept-Encoding: identity Aug 31 13:08:25.189562 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Connection: close Aug 31 13:08:25.189562 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Length: 0 Aug 31 13:08:25.189562 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Type: application/json Aug 31 13:08:25.189562 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Host: 10.222.0.58 Aug 31 13:08:25.189562 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Openstack-System-Scope: None Aug 31 13:08:25.189562 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: User-Agent: python-urllib3/1.26.12 Aug 31 13:08:25.189562 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Auth-Token: gAAAAABjD1uCNSnUQPMlQgFT2jq-eB19r7xLb94uzxGnoJXWTepSWTo7UQTZU86dPbIoFZ8qqdn2aU_O4yRfHOsmgtmeK9yuhxtC117CeRP8ROwyQq4z33BXiou8fAPjfT5vF29_iKZcD17NL5FwHgpz6cSqA2AiwZ_XLORdaExhfMVopvwp8pU Aug 31 13:08:25.189562 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Id: None Aug 31 13:08:25.189562 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Name: None Aug 31 13:08:25.189562 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Identity-Status: Confirmed Aug 31 13:08:25.189562 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Is-Admin-Project: True Aug 31 13:08:25.189562 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Id: default Aug 31 13:08:25.189562 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Name: Default Aug 31 13:08:25.189562 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Id: fdf85a7b31004baf848842ad2f74cbf0 Aug 31 13:08:25.189562 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Name: tempest-AttachVolumeNegativeTest-2039526226 Aug 31 13:08:25.189562 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Role: member,reader Aug 31 13:08:25.189562 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Roles: member,reader Aug 31 13:08:25.191134 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fdf85a7b31004baf848842ad2f74cbf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fdf85a7b31004baf848842ad2f74cbf0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fdf85a7b31004baf848842ad2f74cbf0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fdf85a7b31004baf848842ad2f74cbf0"}]}] Aug 31 13:08:25.191134 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant: tempest-AttachVolumeNegativeTest-2039526226 Aug 31 13:08:25.191134 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Id: fdf85a7b31004baf848842ad2f74cbf0 Aug 31 13:08:25.191134 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2039526226 Aug 31 13:08:25.191134 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User: tempest-AttachVolumeNegativeTest-2039526226-project Aug 31 13:08:25.191134 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Id: default Aug 31 13:08:25.191134 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Name: Default Aug 31 13:08:25.191134 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Id: ac2a50988be24e20be034777225d8106 Aug 31 13:08:25.191134 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Name: tempest-AttachVolumeNegativeTest-2039526226-project Aug 31 13:08:25.191134 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: method: > Aug 31 13:08:25.191134 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: exception: Instance 57462145-0049-4cce-87cf-698a1ebbbee3 could not be found. Aug 31 13:08:25.191134 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: action_args: {'id': '57462145-0049-4cce-87cf-698a1ebbbee3'} Aug 31 13:08:25.192075 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:08:25.192075 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:08:25.192075 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 13:08:25.192075 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 13:08:25.192075 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 13:08:25.192075 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 13:08:25.192075 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 13:08:25.192075 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 13:08:25.192075 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 13:08:25.192075 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 13:08:25.192075 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57462145-0049-4cce-87cf-698a1ebbbee3 could not be found. Aug 31 13:08:25.192075 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:08:25.192075 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:08:25.192075 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:08:25.192075 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:08:25.192075 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:08:25.192075 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:08:25.192075 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:08:25.192075 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:08:25.192075 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:08:25.193594 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:08:25.193594 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 13:08:25.193594 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 13:08:25.193594 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 13:08:25.193594 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 13:08:25.193594 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 13:08:25.193594 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 13:08:25.193594 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57462145-0049-4cce-87cf-698a1ebbbee3 could not be found. Aug 31 13:08:25.193594 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:08:25.193594 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:08:25.193594 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:08:25.193594 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:08:25.193594 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:08:25.193594 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:08:25.193594 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:08:25.193594 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:08:25.193594 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57462145-0049-4cce-87cf-698a1ebbbee3 could not be found. Aug 31 13:08:25.193594 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:08:25.194883 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-6b8c7879-d970-44f8-ae9e-68f80343b199 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Returning 404 to user: Instance 57462145-0049-4cce-87cf-698a1ebbbee3 could not be found. {{(pid=120704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:08:25.194883 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-6b8c7879-d970-44f8-ae9e-68f80343b199 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3" status: 404 len: 111 microversion: 2.1 time: 0.034264 Aug 31 13:08:25.194883 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 393/769] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:08:25 2022] GET /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:08:25.199904 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-f50f34f5-0d63-4291-bcb0-a1967970be24 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '.version_select at 0x7f19512acdc0>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:08:25.220990 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-f50f34f5-0d63-4291-bcb0-a1967970be24 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-317594431" status: 202 len: 0 microversion: 2.1 time: 0.025063 Aug 31 13:08:25.221556 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 377/770] 10.222.0.58 () {58 vars in 1218 bytes} [Wed Aug 31 13:08:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-317594431 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:08:25.859620 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-7244d44d-bad7-4eea-8bb7-f06f6eb39884 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Action: 'create', calling method: .version_select at 0x7f1951346d30>, body: {"keypair": {"name": "tempest-keypair-1176202852", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPDvgl0UK+O5RpYCi7Y7VjjMeVQDmZMA9zb/TOgclbqm1VXn1ii6VejzfNfxn9Spq0bndBA+U810DdSwx+z9dH7XWYLsiF0tWTtRXzCpu6YBSPmiWVz83APZNipqvfuBYQ=="}} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:08:25.875340 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.quota [None req-7244d44d-bad7-4eea-8bb7-f06f6eb39884 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Getting quotas for project fdf85a7b31004baf848842ad2f74cbf0. Resources: {'key_pairs'} {{(pid=120704) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 13:08:25.879232 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.quota [None req-7244d44d-bad7-4eea-8bb7-f06f6eb39884 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Getting quotas for user ac2a50988be24e20be034777225d8106 and project fdf85a7b31004baf848842ad2f74cbf0. Resources: {'key_pairs'} {{(pid=120704) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 13:08:25.904000 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-7244d44d-bad7-4eea-8bb7-f06f6eb39884 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048250 Aug 31 13:08:25.904617 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 394/771] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 31 13:08:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:08:27.209643 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-88135b4c-a87e-4d4b-bdce-ad22928ca020 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-130979515", "imageRef": "2aa55919-0f25-4e84-a2e1-f60acbe208b2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fb3a8ad8-8a96-4988-83d8-367334d3fb95"}], "security_groups": [{"name": "tempest-securitygroup--166632171"}], "key_name": "tempest-keypair-1176202852", "user_data": "}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:08:27.319134 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.network.neutron [None req-88135b4c-a87e-4d4b-bdce-ad22928ca020 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] validate_networks() for [('fb3a8ad8-8a96-4988-83d8-367334d3fb95', None, None, None, None, None)] {{(pid=120705) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 13:08:27.701612 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-88135b4c-a87e-4d4b-bdce-ad22928ca020 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Flavor limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 13:08:27.702243 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-88135b4c-a87e-4d4b-bdce-ad22928ca020 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Image limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 13:08:27.702831 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-88135b4c-a87e-4d4b-bdce-ad22928ca020 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Flavor pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 13:08:27.703370 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-88135b4c-a87e-4d4b-bdce-ad22928ca020 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Image pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 13:08:27.703975 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-88135b4c-a87e-4d4b-bdce-ad22928ca020 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 13:08:27.715979 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-88135b4c-a87e-4d4b-bdce-ad22928ca020 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:27.716483 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-88135b4c-a87e-4d4b-bdce-ad22928ca020 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:27.717133 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-88135b4c-a87e-4d4b-bdce-ad22928ca020 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:27.717851 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-88135b4c-a87e-4d4b-bdce-ad22928ca020 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:27.718296 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-88135b4c-a87e-4d4b-bdce-ad22928ca020 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:27.718711 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-88135b4c-a87e-4d4b-bdce-ad22928ca020 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:27.735384 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-88135b4c-a87e-4d4b-bdce-ad22928ca020 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Getting quotas for project fdf85a7b31004baf848842ad2f74cbf0. Resources: {'instances', 'ram', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 13:08:27.739326 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-88135b4c-a87e-4d4b-bdce-ad22928ca020 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Getting quotas for user ac2a50988be24e20be034777225d8106 and project fdf85a7b31004baf848842ad2f74cbf0. Resources: {'instances', 'ram', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 13:08:27.750247 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-88135b4c-a87e-4d4b-bdce-ad22928ca020 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Going to run 1 instances... {{(pid=120705) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 13:08:27.752471 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-88135b4c-a87e-4d4b-bdce-ad22928ca020 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2aa55919-0f25-4e84-a2e1-f60acbe208b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120705) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 13:08:27.802796 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-88135b4c-a87e-4d4b-bdce-ad22928ca020 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.597985 Aug 31 13:08:27.803442 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 378/772] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 31 13:08:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 13:08:27.815419 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-ebbd1b31-6e47-4976-93f8-bd837a7a7ed4 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:08:27.816610 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-ebbd1b31-6e47-4976-93f8-bd837a7a7ed4 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:08:27.878071 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-ebbd1b31-6e47-4976-93f8-bd837a7a7ed4 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:08:27.885454 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-ebbd1b31-6e47-4976-93f8-bd837a7a7ed4 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad" status: 200 len: 1241 microversion: 2.1 time: 0.074827 Aug 31 13:08:27.886200 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 395/773] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:08:27 2022] GET /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad => generated 1241 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:08:28.908268 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-7922a4cf-75c6-487f-afd7-767b6e18fb6d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:08:28.908827 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-7922a4cf-75c6-487f-afd7-767b6e18fb6d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:08:28.915983 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7922a4cf-75c6-487f-afd7-767b6e18fb6d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:28.916463 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7922a4cf-75c6-487f-afd7-767b6e18fb6d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:28.916900 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7922a4cf-75c6-487f-afd7-767b6e18fb6d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:28.917593 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7922a4cf-75c6-487f-afd7-767b6e18fb6d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:28.918044 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7922a4cf-75c6-487f-afd7-767b6e18fb6d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:28.918466 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7922a4cf-75c6-487f-afd7-767b6e18fb6d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:29.236982 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-7922a4cf-75c6-487f-afd7-767b6e18fb6d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:08:29.245258 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-7922a4cf-75c6-487f-afd7-767b6e18fb6d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad" status: 200 len: 1293 microversion: 2.1 time: 0.341762 Aug 31 13:08:29.245857 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 379/774] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:08:28 2022] GET /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad => generated 1293 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:08:30.267216 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-f49ece9f-b6f5-46ba-ba8c-1d08e97b9f37 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:08:30.267857 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-f49ece9f-b6f5-46ba-ba8c-1d08e97b9f37 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:08:30.274938 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f49ece9f-b6f5-46ba-ba8c-1d08e97b9f37 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:30.275441 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f49ece9f-b6f5-46ba-ba8c-1d08e97b9f37 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:30.276038 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f49ece9f-b6f5-46ba-ba8c-1d08e97b9f37 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:30.276823 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f49ece9f-b6f5-46ba-ba8c-1d08e97b9f37 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:30.277278 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f49ece9f-b6f5-46ba-ba8c-1d08e97b9f37 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:30.277699 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f49ece9f-b6f5-46ba-ba8c-1d08e97b9f37 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:30.407228 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-f49ece9f-b6f5-46ba-ba8c-1d08e97b9f37 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:08:30.415341 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-f49ece9f-b6f5-46ba-ba8c-1d08e97b9f37 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad" status: 200 len: 1366 microversion: 2.1 time: 0.152499 Aug 31 13:08:30.415934 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 396/775] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:08:30 2022] GET /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:08:30.606046 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-0d8f45e1-694b-424a-ba74-e1964ca97048 req-8537b6b1-303f-4c21-8820-94e42287ae40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92157027-9f9d-4c1a-8b0c-e7e5ad9253ad", "tag": "ae061448-8f9b-4b03-b6a8-f247e6415329"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:08:30.617490 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-0d8f45e1-694b-424a-ba74-e1964ca97048 req-8537b6b1-303f-4c21-8820-94e42287ae40 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:30.618073 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-0d8f45e1-694b-424a-ba74-e1964ca97048 req-8537b6b1-303f-4c21-8820-94e42287ae40 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:30.618852 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-0d8f45e1-694b-424a-ba74-e1964ca97048 req-8537b6b1-303f-4c21-8820-94e42287ae40 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:30.630217 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-0d8f45e1-694b-424a-ba74-e1964ca97048 req-8537b6b1-303f-4c21-8820-94e42287ae40 service nova] Creating event network-changed:ae061448-8f9b-4b03-b6a8-f247e6415329 for instance 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad on hv-cinder-85442 Aug 31 13:08:30.635301 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-0d8f45e1-694b-424a-ba74-e1964ca97048 req-8537b6b1-303f-4c21-8820-94e42287ae40 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033619 Aug 31 13:08:30.635959 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 380/776] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:08:31.441645 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-7b0dd694-4b4e-4e8a-a201-3f32ef729ab9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:08:31.442647 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-7b0dd694-4b4e-4e8a-a201-3f32ef729ab9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:08:31.453723 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7b0dd694-4b4e-4e8a-a201-3f32ef729ab9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:31.454510 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7b0dd694-4b4e-4e8a-a201-3f32ef729ab9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:31.455240 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7b0dd694-4b4e-4e8a-a201-3f32ef729ab9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:31.456438 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7b0dd694-4b4e-4e8a-a201-3f32ef729ab9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:31.457196 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7b0dd694-4b4e-4e8a-a201-3f32ef729ab9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:31.457891 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7b0dd694-4b4e-4e8a-a201-3f32ef729ab9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:31.596864 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-7b0dd694-4b4e-4e8a-a201-3f32ef729ab9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:08:31.606680 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-7b0dd694-4b4e-4e8a-a201-3f32ef729ab9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad" status: 200 len: 1366 microversion: 2.1 time: 0.171736 Aug 31 13:08:31.607228 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 397/777] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:08:31 2022] GET /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:08:32.633254 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-0f0050b4-2691-435b-825c-4afdfb8b5b9a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:08:32.634476 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-0f0050b4-2691-435b-825c-4afdfb8b5b9a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:08:32.641171 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0f0050b4-2691-435b-825c-4afdfb8b5b9a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:32.641641 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0f0050b4-2691-435b-825c-4afdfb8b5b9a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:32.642062 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0f0050b4-2691-435b-825c-4afdfb8b5b9a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:32.642738 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0f0050b4-2691-435b-825c-4afdfb8b5b9a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:32.643180 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0f0050b4-2691-435b-825c-4afdfb8b5b9a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:32.643592 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0f0050b4-2691-435b-825c-4afdfb8b5b9a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:32.773146 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-0f0050b4-2691-435b-825c-4afdfb8b5b9a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:08:32.781303 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-0f0050b4-2691-435b-825c-4afdfb8b5b9a tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad" status: 200 len: 1366 microversion: 2.1 time: 0.156030 Aug 31 13:08:32.781871 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 381/778] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:08:32 2022] GET /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:08:33.802982 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-c8e7b45b-2979-4c23-91ce-f5604821a298 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:08:33.803588 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-c8e7b45b-2979-4c23-91ce-f5604821a298 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:08:33.810604 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c8e7b45b-2979-4c23-91ce-f5604821a298 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:33.811086 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c8e7b45b-2979-4c23-91ce-f5604821a298 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:33.811506 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c8e7b45b-2979-4c23-91ce-f5604821a298 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:33.812262 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c8e7b45b-2979-4c23-91ce-f5604821a298 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:33.812734 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c8e7b45b-2979-4c23-91ce-f5604821a298 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:33.813146 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c8e7b45b-2979-4c23-91ce-f5604821a298 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:33.957501 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-c8e7b45b-2979-4c23-91ce-f5604821a298 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:08:33.967565 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-c8e7b45b-2979-4c23-91ce-f5604821a298 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad" status: 200 len: 1366 microversion: 2.1 time: 0.168618 Aug 31 13:08:33.968177 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 398/779] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:08:33 2022] GET /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:08:34.989247 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-dadfd726-6052-438b-8959-355dce29bb94 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:08:34.989864 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-dadfd726-6052-438b-8959-355dce29bb94 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:08:34.996847 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dadfd726-6052-438b-8959-355dce29bb94 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:34.997634 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dadfd726-6052-438b-8959-355dce29bb94 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:34.998093 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dadfd726-6052-438b-8959-355dce29bb94 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:34.998794 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dadfd726-6052-438b-8959-355dce29bb94 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:34.999246 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dadfd726-6052-438b-8959-355dce29bb94 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:34.999673 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dadfd726-6052-438b-8959-355dce29bb94 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:35.131777 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-dadfd726-6052-438b-8959-355dce29bb94 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:08:35.139925 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-dadfd726-6052-438b-8959-355dce29bb94 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad" status: 200 len: 1366 microversion: 2.1 time: 0.154614 Aug 31 13:08:35.140514 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 382/780] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:08:34 2022] GET /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:08:36.164970 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-7a2ea3da-5e53-4d88-840a-4dc3e6f59817 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:08:36.165996 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-7a2ea3da-5e53-4d88-840a-4dc3e6f59817 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:08:36.182536 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7a2ea3da-5e53-4d88-840a-4dc3e6f59817 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:36.183302 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7a2ea3da-5e53-4d88-840a-4dc3e6f59817 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:36.184083 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7a2ea3da-5e53-4d88-840a-4dc3e6f59817 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:36.185208 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7a2ea3da-5e53-4d88-840a-4dc3e6f59817 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:36.185939 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7a2ea3da-5e53-4d88-840a-4dc3e6f59817 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:36.186668 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7a2ea3da-5e53-4d88-840a-4dc3e6f59817 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:36.341338 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-7a2ea3da-5e53-4d88-840a-4dc3e6f59817 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:08:36.354215 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-7a2ea3da-5e53-4d88-840a-4dc3e6f59817 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad" status: 200 len: 1366 microversion: 2.1 time: 0.195520 Aug 31 13:08:36.355127 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 399/781] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:08:36 2022] GET /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:08:37.105483 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-4f5a6ec0-2374-404a-8e1a-bf7daede6c87 req-e8acb165-9976-4cd5-b5ac-cb28d25648a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92157027-9f9d-4c1a-8b0c-e7e5ad9253ad", "name": "network-vif-plugged", "status": "completed", "tag": "ae061448-8f9b-4b03-b6a8-f247e6415329"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:08:37.115641 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-4f5a6ec0-2374-404a-8e1a-bf7daede6c87 req-e8acb165-9976-4cd5-b5ac-cb28d25648a3 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:37.116200 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-4f5a6ec0-2374-404a-8e1a-bf7daede6c87 req-e8acb165-9976-4cd5-b5ac-cb28d25648a3 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:37.117054 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-4f5a6ec0-2374-404a-8e1a-bf7daede6c87 req-e8acb165-9976-4cd5-b5ac-cb28d25648a3 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:37.129143 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-4f5a6ec0-2374-404a-8e1a-bf7daede6c87 req-e8acb165-9976-4cd5-b5ac-cb28d25648a3 service nova] Creating event network-vif-plugged:ae061448-8f9b-4b03-b6a8-f247e6415329 for instance 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad on hv-cinder-85442 Aug 31 13:08:37.134398 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-4f5a6ec0-2374-404a-8e1a-bf7daede6c87 req-e8acb165-9976-4cd5-b5ac-cb28d25648a3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032674 Aug 31 13:08:37.135000 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 383/782] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:08:37.375984 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-6e5319f2-93d3-4c9d-a5b6-2cb670d27b41 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:08:37.376561 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-6e5319f2-93d3-4c9d-a5b6-2cb670d27b41 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:08:37.383412 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6e5319f2-93d3-4c9d-a5b6-2cb670d27b41 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:37.383918 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6e5319f2-93d3-4c9d-a5b6-2cb670d27b41 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:37.384348 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6e5319f2-93d3-4c9d-a5b6-2cb670d27b41 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:37.385056 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6e5319f2-93d3-4c9d-a5b6-2cb670d27b41 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:37.385498 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6e5319f2-93d3-4c9d-a5b6-2cb670d27b41 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:37.385911 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6e5319f2-93d3-4c9d-a5b6-2cb670d27b41 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:37.528162 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-6e5319f2-93d3-4c9d-a5b6-2cb670d27b41 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:08:37.536517 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-6e5319f2-93d3-4c9d-a5b6-2cb670d27b41 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad" status: 200 len: 1366 microversion: 2.1 time: 0.164610 Aug 31 13:08:37.537107 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 400/783] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:08:37 2022] GET /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:08:38.557957 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=2 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:08:38.559019 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=6 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:08:38.565133 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-77f9520d-3679-4733-b1a9-11ceeb27d5c9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:08:38.565830 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-77f9520d-3679-4733-b1a9-11ceeb27d5c9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:08:38.573300 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-77f9520d-3679-4733-b1a9-11ceeb27d5c9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:38.573774 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-77f9520d-3679-4733-b1a9-11ceeb27d5c9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:38.574200 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-77f9520d-3679-4733-b1a9-11ceeb27d5c9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:38.574886 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-77f9520d-3679-4733-b1a9-11ceeb27d5c9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:38.575365 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-77f9520d-3679-4733-b1a9-11ceeb27d5c9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:38.575774 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-77f9520d-3679-4733-b1a9-11ceeb27d5c9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:38.710611 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-77f9520d-3679-4733-b1a9-11ceeb27d5c9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:08:38.721308 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-77f9520d-3679-4733-b1a9-11ceeb27d5c9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad" status: 200 len: 1366 microversion: 2.1 time: 0.165163 Aug 31 13:08:38.721885 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 384/784] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:08:38 2022] GET /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:08:39.753361 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-4145de04-7a27-437e-a32d-f68c5f080a47 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:08:39.754466 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-4145de04-7a27-437e-a32d-f68c5f080a47 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:08:39.757528 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell0:SELECT=6 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:08:39.759366 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:08:39.767318 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4145de04-7a27-437e-a32d-f68c5f080a47 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:39.767791 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4145de04-7a27-437e-a32d-f68c5f080a47 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:39.768240 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4145de04-7a27-437e-a32d-f68c5f080a47 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:39.768920 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4145de04-7a27-437e-a32d-f68c5f080a47 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:39.769366 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4145de04-7a27-437e-a32d-f68c5f080a47 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:39.769781 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4145de04-7a27-437e-a32d-f68c5f080a47 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:39.773462 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:08:39.924761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-4145de04-7a27-437e-a32d-f68c5f080a47 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:08:39.932901 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-4145de04-7a27-437e-a32d-f68c5f080a47 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad" status: 200 len: 1555 microversion: 2.1 time: 0.186009 Aug 31 13:08:39.933495 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 401/785] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:08:39 2022] GET /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad => generated 1555 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:08:39.956886 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-ab284cd7-3b74-450d-b43b-d8e66e54c0ba tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:08:39.957392 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-ab284cd7-3b74-450d-b43b-d8e66e54c0ba tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:08:39.967993 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ab284cd7-3b74-450d-b43b-d8e66e54c0ba tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:39.968500 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ab284cd7-3b74-450d-b43b-d8e66e54c0ba tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:39.968974 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ab284cd7-3b74-450d-b43b-d8e66e54c0ba tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:39.969956 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ab284cd7-3b74-450d-b43b-d8e66e54c0ba tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:39.970438 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ab284cd7-3b74-450d-b43b-d8e66e54c0ba tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:39.971008 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-ab284cd7-3b74-450d-b43b-d8e66e54c0ba tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:40.063179 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-ab284cd7-3b74-450d-b43b-d8e66e54c0ba tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.113093 Aug 31 13:08:40.063778 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 385/786] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 31 13:08:39 2022] GET /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad/os-interface => generated 284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:08:41.048923 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-1df16f79-2214-4d5f-9368-160b154e0197 req-02bdfafc-278f-446c-a2f9-2fc484dd0894 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92157027-9f9d-4c1a-8b0c-e7e5ad9253ad", "tag": "ae061448-8f9b-4b03-b6a8-f247e6415329"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:08:41.059070 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-1df16f79-2214-4d5f-9368-160b154e0197 req-02bdfafc-278f-446c-a2f9-2fc484dd0894 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:41.059545 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-1df16f79-2214-4d5f-9368-160b154e0197 req-02bdfafc-278f-446c-a2f9-2fc484dd0894 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:41.059996 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-1df16f79-2214-4d5f-9368-160b154e0197 req-02bdfafc-278f-446c-a2f9-2fc484dd0894 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:41.071611 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-1df16f79-2214-4d5f-9368-160b154e0197 req-02bdfafc-278f-446c-a2f9-2fc484dd0894 service nova] Creating event network-changed:ae061448-8f9b-4b03-b6a8-f247e6415329 for instance 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad on hv-cinder-85442 Aug 31 13:08:41.076862 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-1df16f79-2214-4d5f-9368-160b154e0197 req-02bdfafc-278f-446c-a2f9-2fc484dd0894 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031819 Aug 31 13:08:41.077646 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 402/787] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:08:52.547640 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:08:52.548896 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:08:52.555749 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-324a9b37-67a2-4d16-875e-da2c3059503c tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:08:52.556799 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-324a9b37-67a2-4d16-875e-da2c3059503c tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 49803c3f-e096-4c19-a579-3224e6fe2809] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:08:52.568805 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-324a9b37-67a2-4d16-875e-da2c3059503c tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:52.569293 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-324a9b37-67a2-4d16-875e-da2c3059503c tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:52.569729 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-324a9b37-67a2-4d16-875e-da2c3059503c tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:52.570648 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-324a9b37-67a2-4d16-875e-da2c3059503c tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:52.571094 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-324a9b37-67a2-4d16-875e-da2c3059503c tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:52.571507 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-324a9b37-67a2-4d16-875e-da2c3059503c tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:52.596851 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-324a9b37-67a2-4d16-875e-da2c3059503c tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809/ips" status: 200 len: 145 microversion: 2.1 time: 0.051629 Aug 31 13:08:52.597424 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 386/788] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 31 13:08:52 2022] GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809/ips => generated 145 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:08:53.943563 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_api:SELECT=3 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:08:53.944357 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell1:SELECT=7 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:08:53.949085 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-1a80494b-d524-4817-b29b-652c8bbd2914 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a4ae14c-e673-4f5d-928e-7a361905dce2"}} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:08:53.951451 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-1a80494b-d524-4817-b29b-652c8bbd2914 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 49803c3f-e096-4c19-a579-3224e6fe2809] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:08:53.958381 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1a80494b-d524-4817-b29b-652c8bbd2914 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:53.958857 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1a80494b-d524-4817-b29b-652c8bbd2914 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:53.959289 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1a80494b-d524-4817-b29b-652c8bbd2914 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:53.960022 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1a80494b-d524-4817-b29b-652c8bbd2914 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:08:53.960451 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1a80494b-d524-4817-b29b-652c8bbd2914 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:08:53.960871 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1a80494b-d524-4817-b29b-652c8bbd2914 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:08:54.238619 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-1a80494b-d524-4817-b29b-652c8bbd2914 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "POST /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296391 Aug 31 13:08:54.239255 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 403/789] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 31 13:08:53 2022] POST /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:09:01.836523 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-d3640005-41e1-404b-b044-509470246e8c tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:01.838718 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-d3640005-41e1-404b-b044-509470246e8c tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 49803c3f-e096-4c19-a579-3224e6fe2809] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:01.845802 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d3640005-41e1-404b-b044-509470246e8c tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:01.846286 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d3640005-41e1-404b-b044-509470246e8c tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:01.846718 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d3640005-41e1-404b-b044-509470246e8c tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:01.847415 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d3640005-41e1-404b-b044-509470246e8c tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:01.847928 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d3640005-41e1-404b-b044-509470246e8c tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:01.848355 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d3640005-41e1-404b-b044-509470246e8c tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:01.878163 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-d3640005-41e1-404b-b044-509470246e8c tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045665 Aug 31 13:09:01.878730 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 387/790] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 31 13:09:01 2022] GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:09:01.890999 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-eb30d2ef-ac1f-480a-80b3-9a79c2369250 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:01.891564 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-eb30d2ef-ac1f-480a-80b3-9a79c2369250 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 49803c3f-e096-4c19-a579-3224e6fe2809] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:01.898471 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-eb30d2ef-ac1f-480a-80b3-9a79c2369250 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:01.898965 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-eb30d2ef-ac1f-480a-80b3-9a79c2369250 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:01.899395 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-eb30d2ef-ac1f-480a-80b3-9a79c2369250 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:01.900132 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-eb30d2ef-ac1f-480a-80b3-9a79c2369250 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:01.900580 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-eb30d2ef-ac1f-480a-80b3-9a79c2369250 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:01.900998 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-eb30d2ef-ac1f-480a-80b3-9a79c2369250 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:01.931851 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-eb30d2ef-ac1f-480a-80b3-9a79c2369250 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809/os-volume_attachments/4a4ae14c-e673-4f5d-928e-7a361905dce2" status: 200 len: 194 microversion: 2.1 time: 0.045949 Aug 31 13:09:01.932517 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 404/791] 10.222.0.58 () {58 vars in 1413 bytes} [Wed Aug 31 13:09:01 2022] GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809/os-volume_attachments/4a4ae14c-e673-4f5d-928e-7a361905dce2 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:09:03.279994 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3f20b970-cb24-409c-9b7f-a507a0c84aa8 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a692ac1e-2983-4ffb-bfc8-a7c0e4cb85b1"}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:09:03.282319 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-3f20b970-cb24-409c-9b7f-a507a0c84aa8 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 49803c3f-e096-4c19-a579-3224e6fe2809] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:03.289221 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3f20b970-cb24-409c-9b7f-a507a0c84aa8 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:03.289856 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3f20b970-cb24-409c-9b7f-a507a0c84aa8 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:03.290305 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3f20b970-cb24-409c-9b7f-a507a0c84aa8 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:03.290998 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3f20b970-cb24-409c-9b7f-a507a0c84aa8 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:03.291468 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3f20b970-cb24-409c-9b7f-a507a0c84aa8 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:03.291919 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3f20b970-cb24-409c-9b7f-a507a0c84aa8 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:03.782523 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-3f20b970-cb24-409c-9b7f-a507a0c84aa8 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "POST /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.506737 Aug 31 13:09:03.783334 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 388/792] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 31 13:09:03 2022] POST /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809/os-volume_attachments => generated 194 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:09:11.373897 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-f1b2f912-3664-4ba5-b28f-90c8a6eab243 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:11.376208 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-f1b2f912-3664-4ba5-b28f-90c8a6eab243 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 49803c3f-e096-4c19-a579-3224e6fe2809] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:11.383130 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f1b2f912-3664-4ba5-b28f-90c8a6eab243 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:11.383600 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f1b2f912-3664-4ba5-b28f-90c8a6eab243 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:11.384090 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f1b2f912-3664-4ba5-b28f-90c8a6eab243 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:11.384770 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f1b2f912-3664-4ba5-b28f-90c8a6eab243 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:11.385210 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f1b2f912-3664-4ba5-b28f-90c8a6eab243 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:11.385615 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f1b2f912-3664-4ba5-b28f-90c8a6eab243 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:11.416703 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-f1b2f912-3664-4ba5-b28f-90c8a6eab243 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046792 Aug 31 13:09:11.417319 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 405/793] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 31 13:09:11 2022] GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:09:11.558328 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-522ecb2d-e749-4c43-ba8f-0c2f031aa592 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:11.558927 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-522ecb2d-e749-4c43-ba8f-0c2f031aa592 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 49803c3f-e096-4c19-a579-3224e6fe2809] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:11.565830 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-522ecb2d-e749-4c43-ba8f-0c2f031aa592 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:11.566306 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-522ecb2d-e749-4c43-ba8f-0c2f031aa592 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:11.566724 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-522ecb2d-e749-4c43-ba8f-0c2f031aa592 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:11.567406 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-522ecb2d-e749-4c43-ba8f-0c2f031aa592 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:11.567847 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-522ecb2d-e749-4c43-ba8f-0c2f031aa592 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:11.568287 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-522ecb2d-e749-4c43-ba8f-0c2f031aa592 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:11.597565 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-522ecb2d-e749-4c43-ba8f-0c2f031aa592 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809/os-volume_attachments/4a4ae14c-e673-4f5d-928e-7a361905dce2" status: 200 len: 194 microversion: 2.1 time: 0.043686 Aug 31 13:09:11.598136 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 389/794] 10.222.0.58 () {58 vars in 1413 bytes} [Wed Aug 31 13:09:11 2022] GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809/os-volume_attachments/4a4ae14c-e673-4f5d-928e-7a361905dce2 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:09:11.611456 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-7d387c20-062c-4c41-8300-b6d26d1f0e9a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:11.612177 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-7d387c20-062c-4c41-8300-b6d26d1f0e9a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 49803c3f-e096-4c19-a579-3224e6fe2809] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:11.621270 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7d387c20-062c-4c41-8300-b6d26d1f0e9a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:11.621959 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7d387c20-062c-4c41-8300-b6d26d1f0e9a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:11.622586 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7d387c20-062c-4c41-8300-b6d26d1f0e9a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:11.623578 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7d387c20-062c-4c41-8300-b6d26d1f0e9a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:11.624189 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7d387c20-062c-4c41-8300-b6d26d1f0e9a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:11.624668 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7d387c20-062c-4c41-8300-b6d26d1f0e9a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:11.765452 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.objects.instance [None req-7d387c20-062c-4c41-8300-b6d26d1f0e9a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lazy-loading 'services' on Instance uuid 49803c3f-e096-4c19-a579-3224e6fe2809 {{(pid=120704) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 13:09:11.851853 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-7d387c20-062c-4c41-8300-b6d26d1f0e9a tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "DELETE /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809/os-volume_attachments/4a4ae14c-e673-4f5d-928e-7a361905dce2" status: 202 len: 0 microversion: 2.1 time: 0.246592 Aug 31 13:09:11.852467 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 406/795] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 31 13:09:11 2022] DELETE /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809/os-volume_attachments/4a4ae14c-e673-4f5d-928e-7a361905dce2 => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:09:14.046358 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-64cffb75-1ec3-4882-a38f-128c420ffe23 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:14.046900 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-64cffb75-1ec3-4882-a38f-128c420ffe23 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 49803c3f-e096-4c19-a579-3224e6fe2809] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:14.053907 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-64cffb75-1ec3-4882-a38f-128c420ffe23 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:14.054400 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-64cffb75-1ec3-4882-a38f-128c420ffe23 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:14.054835 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-64cffb75-1ec3-4882-a38f-128c420ffe23 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:14.055525 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-64cffb75-1ec3-4882-a38f-128c420ffe23 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:14.056014 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-64cffb75-1ec3-4882-a38f-128c420ffe23 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:14.056435 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-64cffb75-1ec3-4882-a38f-128c420ffe23 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:14.086420 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-64cffb75-1ec3-4882-a38f-128c420ffe23 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809/os-volume_attachments/a692ac1e-2983-4ffb-bfc8-a7c0e4cb85b1" status: 200 len: 194 microversion: 2.1 time: 0.044145 Aug 31 13:09:14.087044 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 390/796] 10.222.0.58 () {58 vars in 1413 bytes} [Wed Aug 31 13:09:14 2022] GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809/os-volume_attachments/a692ac1e-2983-4ffb-bfc8-a7c0e4cb85b1 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:09:14.099566 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-01eaf413-9e5d-44a7-b0e8-1e5c81e831ba tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:14.100159 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-01eaf413-9e5d-44a7-b0e8-1e5c81e831ba tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 49803c3f-e096-4c19-a579-3224e6fe2809] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:14.106767 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-01eaf413-9e5d-44a7-b0e8-1e5c81e831ba tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:14.107240 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-01eaf413-9e5d-44a7-b0e8-1e5c81e831ba tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:14.107731 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-01eaf413-9e5d-44a7-b0e8-1e5c81e831ba tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:14.108445 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-01eaf413-9e5d-44a7-b0e8-1e5c81e831ba tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:14.108887 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-01eaf413-9e5d-44a7-b0e8-1e5c81e831ba tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:14.109297 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-01eaf413-9e5d-44a7-b0e8-1e5c81e831ba tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:14.196000 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.objects.instance [None req-01eaf413-9e5d-44a7-b0e8-1e5c81e831ba tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lazy-loading 'services' on Instance uuid 49803c3f-e096-4c19-a579-3224e6fe2809 {{(pid=120704) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 13:09:14.285291 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-01eaf413-9e5d-44a7-b0e8-1e5c81e831ba tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "DELETE /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809/os-volume_attachments/a692ac1e-2983-4ffb-bfc8-a7c0e4cb85b1" status: 202 len: 0 microversion: 2.1 time: 0.190648 Aug 31 13:09:14.285896 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 407/797] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 31 13:09:14 2022] DELETE /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809/os-volume_attachments/a692ac1e-2983-4ffb-bfc8-a7c0e4cb85b1 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:09:15.460478 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-a75659e7-91f5-4e24-af80-ba76104a2e32 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:15.462774 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-a75659e7-91f5-4e24-af80-ba76104a2e32 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 49803c3f-e096-4c19-a579-3224e6fe2809] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:15.469856 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a75659e7-91f5-4e24-af80-ba76104a2e32 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:15.470330 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a75659e7-91f5-4e24-af80-ba76104a2e32 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:15.470772 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a75659e7-91f5-4e24-af80-ba76104a2e32 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:15.471459 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a75659e7-91f5-4e24-af80-ba76104a2e32 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:15.471912 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a75659e7-91f5-4e24-af80-ba76104a2e32 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:15.472345 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a75659e7-91f5-4e24-af80-ba76104a2e32 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:15.503137 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-a75659e7-91f5-4e24-af80-ba76104a2e32 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046822 Aug 31 13:09:15.503730 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 391/798] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 31 13:09:15 2022] GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 13:09:15.622961 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-13ab8471-b657-40bb-9178-750b7d8303bd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:15.626048 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-13ab8471-b657-40bb-9178-750b7d8303bd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 49803c3f-e096-4c19-a579-3224e6fe2809] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:15.633736 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-13ab8471-b657-40bb-9178-750b7d8303bd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:15.634220 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-13ab8471-b657-40bb-9178-750b7d8303bd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:15.635733 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-13ab8471-b657-40bb-9178-750b7d8303bd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:15.636501 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-13ab8471-b657-40bb-9178-750b7d8303bd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:15.636981 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-13ab8471-b657-40bb-9178-750b7d8303bd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:15.637543 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-13ab8471-b657-40bb-9178-750b7d8303bd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:15.669567 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-13ab8471-b657-40bb-9178-750b7d8303bd tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052717 Aug 31 13:09:15.670159 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 408/799] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 31 13:09:15 2022] GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 13:09:15.731423 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-9bccb30c-69ed-404d-8fa3-061cbb8f91d6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:15.731940 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-9bccb30c-69ed-404d-8fa3-061cbb8f91d6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 49803c3f-e096-4c19-a579-3224e6fe2809] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:15.738193 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9bccb30c-69ed-404d-8fa3-061cbb8f91d6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:15.738671 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9bccb30c-69ed-404d-8fa3-061cbb8f91d6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:15.739091 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9bccb30c-69ed-404d-8fa3-061cbb8f91d6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:15.739779 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9bccb30c-69ed-404d-8fa3-061cbb8f91d6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:15.740275 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9bccb30c-69ed-404d-8fa3-061cbb8f91d6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:15.740713 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9bccb30c-69ed-404d-8fa3-061cbb8f91d6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:15.766175 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-9bccb30c-69ed-404d-8fa3-061cbb8f91d6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 49803c3f-e096-4c19-a579-3224e6fe2809] Going to try to terminate instance {{(pid=120705) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 13:09:15.859463 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-9bccb30c-69ed-404d-8fa3-061cbb8f91d6 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "DELETE /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809" status: 204 len: 0 microversion: 2.1 time: 0.131539 Aug 31 13:09:15.860396 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 392/800] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 31 13:09:15 2022] DELETE /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:09:15.869247 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-1a3baa6c-dfca-463a-9471-871b9c334636 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:15.869854 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-1a3baa6c-dfca-463a-9471-871b9c334636 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 49803c3f-e096-4c19-a579-3224e6fe2809] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:15.876229 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1a3baa6c-dfca-463a-9471-871b9c334636 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:15.876698 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1a3baa6c-dfca-463a-9471-871b9c334636 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:15.877140 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1a3baa6c-dfca-463a-9471-871b9c334636 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:15.877808 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1a3baa6c-dfca-463a-9471-871b9c334636 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:15.878241 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1a3baa6c-dfca-463a-9471-871b9c334636 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:15.878668 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1a3baa6c-dfca-463a-9471-871b9c334636 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:16.015105 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-1a3baa6c-dfca-463a-9471-871b9c334636 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:16.023779 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-1a3baa6c-dfca-463a-9471-871b9c334636 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809" status: 200 len: 1673 microversion: 2.1 time: 0.158800 Aug 31 13:09:16.024410 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 409/801] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:09:15 2022] GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809 => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:09:16.542982 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-a3b7431e-ddb6-447e-8c87-2aed5479a011 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:16.543952 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-a3b7431e-ddb6-447e-8c87-2aed5479a011 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:16.554952 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a3b7431e-ddb6-447e-8c87-2aed5479a011 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:16.555527 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a3b7431e-ddb6-447e-8c87-2aed5479a011 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:16.556095 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a3b7431e-ddb6-447e-8c87-2aed5479a011 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:16.557286 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a3b7431e-ddb6-447e-8c87-2aed5479a011 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:16.557939 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a3b7431e-ddb6-447e-8c87-2aed5479a011 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:16.558402 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a3b7431e-ddb6-447e-8c87-2aed5479a011 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:16.583331 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-a3b7431e-ddb6-447e-8c87-2aed5479a011 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d/ips" status: 200 len: 152 microversion: 2.20 time: 0.047590 Aug 31 13:09:16.584044 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 393/802] 10.222.0.58 () {60 vars in 1289 bytes} [Wed Aug 31 13:09:16 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d/ips => generated 152 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:09:17.046377 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-0280bc66-37b9-488e-a21b-c4eb5c4d9db4 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:17.046974 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-0280bc66-37b9-488e-a21b-c4eb5c4d9db4 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 49803c3f-e096-4c19-a579-3224e6fe2809] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:17.053769 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0280bc66-37b9-488e-a21b-c4eb5c4d9db4 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:17.054257 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0280bc66-37b9-488e-a21b-c4eb5c4d9db4 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:17.054685 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0280bc66-37b9-488e-a21b-c4eb5c4d9db4 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:17.055378 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0280bc66-37b9-488e-a21b-c4eb5c4d9db4 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:17.055842 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0280bc66-37b9-488e-a21b-c4eb5c4d9db4 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:17.056277 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0280bc66-37b9-488e-a21b-c4eb5c4d9db4 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:17.192786 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-0280bc66-37b9-488e-a21b-c4eb5c4d9db4 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:17.204879 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-0280bc66-37b9-488e-a21b-c4eb5c4d9db4 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809" status: 200 len: 1673 microversion: 2.1 time: 0.162195 Aug 31 13:09:17.205525 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 410/803] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:09:17 2022] GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809 => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:09:18.231586 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-380777d8-7d3d-4216-add4-0322367d496c tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:18.232657 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-380777d8-7d3d-4216-add4-0322367d496c tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 49803c3f-e096-4c19-a579-3224e6fe2809] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:18.243041 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-380777d8-7d3d-4216-add4-0322367d496c tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:18.243519 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-380777d8-7d3d-4216-add4-0322367d496c tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:18.243999 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-380777d8-7d3d-4216-add4-0322367d496c tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:18.244810 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-380777d8-7d3d-4216-add4-0322367d496c tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:18.245470 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-380777d8-7d3d-4216-add4-0322367d496c tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:18.245689 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-380777d8-7d3d-4216-add4-0322367d496c tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:18.364919 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-3642f944-ad70-4736-b91f-504bd4233d6b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:09:18.366210 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-3642f944-ad70-4736-b91f-504bd4233d6b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:18.373452 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3642f944-ad70-4736-b91f-504bd4233d6b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:18.374315 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3642f944-ad70-4736-b91f-504bd4233d6b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:18.374878 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3642f944-ad70-4736-b91f-504bd4233d6b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:18.375559 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3642f944-ad70-4736-b91f-504bd4233d6b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:18.376432 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3642f944-ad70-4736-b91f-504bd4233d6b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:18.376859 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3642f944-ad70-4736-b91f-504bd4233d6b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:18.380828 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-380777d8-7d3d-4216-add4-0322367d496c tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:18.388793 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-380777d8-7d3d-4216-add4-0322367d496c tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809" status: 200 len: 1673 microversion: 2.1 time: 0.163667 Aug 31 13:09:18.389556 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 394/804] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:09:18 2022] GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809 => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:09:18.402775 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.objects.instance [None req-3642f944-ad70-4736-b91f-504bd4233d6b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lazy-loading 'flavor' on Instance uuid 21c9e3cb-e5b1-428d-8405-ec33632c5f3d {{(pid=120704) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 13:09:18.593727 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-3642f944-ad70-4736-b91f-504bd4233d6b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "POST /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d/action" status: 202 len: 0 microversion: 2.20 time: 0.232671 Aug 31 13:09:18.594461 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 411/805] 10.222.0.58 () {62 vars in 1319 bytes} [Wed Aug 31 13:09:18 2022] POST /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:09:18.604129 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-1e16f74f-3020-4bbd-bdaf-9788d1ef60af tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:18.604820 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-1e16f74f-3020-4bbd-bdaf-9788d1ef60af tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:18.611262 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1e16f74f-3020-4bbd-bdaf-9788d1ef60af tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:18.611746 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1e16f74f-3020-4bbd-bdaf-9788d1ef60af tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:18.612301 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1e16f74f-3020-4bbd-bdaf-9788d1ef60af tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:18.613111 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1e16f74f-3020-4bbd-bdaf-9788d1ef60af tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:18.613591 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1e16f74f-3020-4bbd-bdaf-9788d1ef60af tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:18.614208 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1e16f74f-3020-4bbd-bdaf-9788d1ef60af tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:18.754562 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-1e16f74f-3020-4bbd-bdaf-9788d1ef60af tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:18.762833 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-1e16f74f-3020-4bbd-bdaf-9788d1ef60af tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:18.764293 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-1e16f74f-3020-4bbd-bdaf-9788d1ef60af tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:18.765447 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-1e16f74f-3020-4bbd-bdaf-9788d1ef60af tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1722 microversion: 2.20 time: 0.166475 Aug 31 13:09:18.766007 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 395/806] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:09:18 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:09:19.322532 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-ab0bf8f1-6912-4425-a680-1524255aa879 req-cc9c94bf-0fa2-4a68-bf54-010d67780123 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49803c3f-e096-4c19-a579-3224e6fe2809", "name": "network-vif-deleted", "tag": "923b79d0-6af1-44fa-a04c-563b471d4ada"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:09:19.333733 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-ab0bf8f1-6912-4425-a680-1524255aa879 req-cc9c94bf-0fa2-4a68-bf54-010d67780123 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:19.334206 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-ab0bf8f1-6912-4425-a680-1524255aa879 req-cc9c94bf-0fa2-4a68-bf54-010d67780123 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:19.334636 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-ab0bf8f1-6912-4425-a680-1524255aa879 req-cc9c94bf-0fa2-4a68-bf54-010d67780123 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:19.347350 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-ab0bf8f1-6912-4425-a680-1524255aa879 req-cc9c94bf-0fa2-4a68-bf54-010d67780123 service nova] Creating event network-vif-deleted:923b79d0-6af1-44fa-a04c-563b471d4ada for instance 49803c3f-e096-4c19-a579-3224e6fe2809 on hv-cinder-85442 Aug 31 13:09:19.353305 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-ab0bf8f1-6912-4425-a680-1524255aa879 req-cc9c94bf-0fa2-4a68-bf54-010d67780123 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034919 Aug 31 13:09:19.354098 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 412/807] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:09:19.411213 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3b179df2-efa7-4372-b4e8-f79537f537ee tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:19.411850 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-3b179df2-efa7-4372-b4e8-f79537f537ee tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 49803c3f-e096-4c19-a579-3224e6fe2809] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:19.419222 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3b179df2-efa7-4372-b4e8-f79537f537ee tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:19.419697 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3b179df2-efa7-4372-b4e8-f79537f537ee tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:19.420343 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3b179df2-efa7-4372-b4e8-f79537f537ee tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:19.421559 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3b179df2-efa7-4372-b4e8-f79537f537ee tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:19.422004 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3b179df2-efa7-4372-b4e8-f79537f537ee tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:19.422643 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3b179df2-efa7-4372-b4e8-f79537f537ee tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:19.502703 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-3b179df2-efa7-4372-b4e8-f79537f537ee tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b1d441346f482e9981b1fa4015ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fa7489cdff42fcb41727a407a110a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:19.512184 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-3b179df2-efa7-4372-b4e8-f79537f537ee tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809" status: 200 len: 1322 microversion: 2.1 time: 0.105680 Aug 31 13:09:19.526349 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 396/808] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:09:19 2022] GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809 => generated 1322 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:09:19.789012 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-e4e58b7f-7a6d-4468-8579-6e527cfac4c1 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:19.789700 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-e4e58b7f-7a6d-4468-8579-6e527cfac4c1 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:19.796763 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e4e58b7f-7a6d-4468-8579-6e527cfac4c1 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:19.797241 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e4e58b7f-7a6d-4468-8579-6e527cfac4c1 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:19.797669 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e4e58b7f-7a6d-4468-8579-6e527cfac4c1 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:19.798356 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e4e58b7f-7a6d-4468-8579-6e527cfac4c1 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:19.798798 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e4e58b7f-7a6d-4468-8579-6e527cfac4c1 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:19.799217 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e4e58b7f-7a6d-4468-8579-6e527cfac4c1 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:19.936428 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-e4e58b7f-7a6d-4468-8579-6e527cfac4c1 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:19.945921 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-e4e58b7f-7a6d-4468-8579-6e527cfac4c1 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:19.947567 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-e4e58b7f-7a6d-4468-8579-6e527cfac4c1 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:19.948987 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-e4e58b7f-7a6d-4468-8579-6e527cfac4c1 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1722 microversion: 2.20 time: 0.164320 Aug 31 13:09:19.949739 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 413/809] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:09:19 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:09:20.534675 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-637b6e4e-d00d-42b3-bdd3-cbce1b0f9250 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:20.535274 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-637b6e4e-d00d-42b3-bdd3-cbce1b0f9250 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 49803c3f-e096-4c19-a579-3224e6fe2809] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:20.542697 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-637b6e4e-d00d-42b3-bdd3-cbce1b0f9250 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:20.543160 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-637b6e4e-d00d-42b3-bdd3-cbce1b0f9250 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:20.543711 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-637b6e4e-d00d-42b3-bdd3-cbce1b0f9250 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:20.544574 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-637b6e4e-d00d-42b3-bdd3-cbce1b0f9250 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:20.545015 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-637b6e4e-d00d-42b3-bdd3-cbce1b0f9250 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:20.545461 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-637b6e4e-d00d-42b3-bdd3-cbce1b0f9250 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:20.559959 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-637b6e4e-d00d-42b3-bdd3-cbce1b0f9250 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] HTTP exception thrown: Instance 49803c3f-e096-4c19-a579-3224e6fe2809 could not be found. Aug 31 13:09:20.561597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-637b6e4e-d00d-42b3-bdd3-cbce1b0f9250 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Request method failure captured: Aug 31 13:09:20.561597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: request: GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809 HTTP/1.1 Aug 31 13:09:20.561597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 31 13:09:20.561597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 31 13:09:20.561597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Connection: close Aug 31 13:09:20.561597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 31 13:09:20.561597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 31 13:09:20.561597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Host: 10.222.0.58 Aug 31 13:09:20.561597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 31 13:09:20.561597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 31 13:09:20.561597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjD1seB5V-6Thim3iLBWgY6MZJsNXtjUZevzsLJVZ2NIiotfWIMtCtM4e6lfRHB222sjqzTtrnMO5z2WuJJHzUrBuHBLZK48wTJdmWU766QD_VCAlvS0b0famMH1kFEYrnHSShDM2yU5Kn_FtAJqWs7GunEyKuLclhv9wwGfMN0wYYABk Aug 31 13:09:20.561597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 31 13:09:20.561597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 31 13:09:20.561597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 31 13:09:20.561597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 31 13:09:20.561597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 31 13:09:20.561597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 31 13:09:20.561597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Id: 58fa7489cdff42fcb41727a407a110a4 Aug 31 13:09:20.561597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-AttachVolumeTestJSON-865036811 Aug 31 13:09:20.561597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Role: member,reader Aug 31 13:09:20.561597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Roles: member,reader Aug 31 13:09:20.563264 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_58fa7489cdff42fcb41727a407a110a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/58fa7489cdff42fcb41727a407a110a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/58fa7489cdff42fcb41727a407a110a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/58fa7489cdff42fcb41727a407a110a4"}]}] Aug 31 13:09:20.563264 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-AttachVolumeTestJSON-865036811 Aug 31 13:09:20.563264 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant-Id: 58fa7489cdff42fcb41727a407a110a4 Aug 31 13:09:20.563264 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-AttachVolumeTestJSON-865036811 Aug 31 13:09:20.563264 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User: tempest-AttachVolumeTestJSON-865036811-project Aug 31 13:09:20.563264 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 31 13:09:20.563264 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 31 13:09:20.563264 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Id: 65b1d441346f482e9981b1fa4015ea63 Aug 31 13:09:20.563264 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-AttachVolumeTestJSON-865036811-project Aug 31 13:09:20.563264 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: method: > Aug 31 13:09:20.563264 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: exception: Instance 49803c3f-e096-4c19-a579-3224e6fe2809 could not be found. Aug 31 13:09:20.563264 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: action_args: {'id': '49803c3f-e096-4c19-a579-3224e6fe2809'} Aug 31 13:09:20.564294 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:09:20.564294 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:09:20.564294 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 13:09:20.564294 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 13:09:20.564294 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 13:09:20.564294 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 13:09:20.564294 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 13:09:20.564294 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 13:09:20.564294 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 13:09:20.564294 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 13:09:20.564294 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49803c3f-e096-4c19-a579-3224e6fe2809 could not be found. Aug 31 13:09:20.564294 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:09:20.564294 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:09:20.564294 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:09:20.564294 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:09:20.564294 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:09:20.564294 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:09:20.564294 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:09:20.564294 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:09:20.564294 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:09:20.565823 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:09:20.565823 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 13:09:20.565823 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 13:09:20.565823 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 13:09:20.565823 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 13:09:20.565823 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 13:09:20.565823 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 13:09:20.565823 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49803c3f-e096-4c19-a579-3224e6fe2809 could not be found. Aug 31 13:09:20.565823 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:09:20.565823 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:09:20.565823 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:09:20.565823 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:09:20.565823 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:09:20.565823 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:09:20.565823 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:09:20.565823 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:09:20.565823 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49803c3f-e096-4c19-a579-3224e6fe2809 could not be found. Aug 31 13:09:20.565823 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:09:20.567302 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-637b6e4e-d00d-42b3-bdd3-cbce1b0f9250 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Returning 404 to user: Instance 49803c3f-e096-4c19-a579-3224e6fe2809 could not be found. {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:09:20.567302 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-637b6e4e-d00d-42b3-bdd3-cbce1b0f9250 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809" status: 404 len: 111 microversion: 2.1 time: 0.032363 Aug 31 13:09:20.567302 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 397/810] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:09:20 2022] GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:09:20.572805 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-dd7b6930-0af1-4f86-817e-99d69acb8998 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '.version_select at 0x7f19512404c0>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:20.594912 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-dd7b6930-0af1-4f86-817e-99d69acb8998 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-734555079" status: 202 len: 0 microversion: 2.1 time: 0.026364 Aug 31 13:09:20.595485 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 414/811] 10.222.0.58 () {58 vars in 1218 bytes} [Wed Aug 31 13:09:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-734555079 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:09:20.973342 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-1d7cc88b-e552-4825-99de-c496e900c385 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:20.973935 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-1d7cc88b-e552-4825-99de-c496e900c385 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:20.980312 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1d7cc88b-e552-4825-99de-c496e900c385 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:20.980790 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1d7cc88b-e552-4825-99de-c496e900c385 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:20.981222 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1d7cc88b-e552-4825-99de-c496e900c385 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:20.981911 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1d7cc88b-e552-4825-99de-c496e900c385 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:20.982356 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1d7cc88b-e552-4825-99de-c496e900c385 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:20.982777 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1d7cc88b-e552-4825-99de-c496e900c385 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:21.179209 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-1d7cc88b-e552-4825-99de-c496e900c385 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:21.187769 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-1d7cc88b-e552-4825-99de-c496e900c385 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:21.189232 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-1d7cc88b-e552-4825-99de-c496e900c385 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:21.190416 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-1d7cc88b-e552-4825-99de-c496e900c385 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1722 microversion: 2.20 time: 0.221129 Aug 31 13:09:21.190965 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 398/812] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:09:20 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:09:22.216425 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-386f0fc4-2bdb-402d-8736-3439fc300c60 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:22.217124 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-386f0fc4-2bdb-402d-8736-3439fc300c60 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:22.223537 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-386f0fc4-2bdb-402d-8736-3439fc300c60 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:22.224061 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-386f0fc4-2bdb-402d-8736-3439fc300c60 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:22.224495 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-386f0fc4-2bdb-402d-8736-3439fc300c60 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:22.225182 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-386f0fc4-2bdb-402d-8736-3439fc300c60 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:22.225651 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-386f0fc4-2bdb-402d-8736-3439fc300c60 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:22.226052 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-386f0fc4-2bdb-402d-8736-3439fc300c60 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:22.368895 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-386f0fc4-2bdb-402d-8736-3439fc300c60 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:22.377363 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-386f0fc4-2bdb-402d-8736-3439fc300c60 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:22.378821 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-386f0fc4-2bdb-402d-8736-3439fc300c60 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:22.380032 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-386f0fc4-2bdb-402d-8736-3439fc300c60 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1722 microversion: 2.20 time: 0.168359 Aug 31 13:09:22.380598 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 415/813] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:09:22 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:09:23.410415 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b6d8bb34-0d57-4020-a0c4-13986cfffd61 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:23.411408 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b6d8bb34-0d57-4020-a0c4-13986cfffd61 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:23.415370 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:09:23.424229 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b6d8bb34-0d57-4020-a0c4-13986cfffd61 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:23.425075 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b6d8bb34-0d57-4020-a0c4-13986cfffd61 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:23.425761 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b6d8bb34-0d57-4020-a0c4-13986cfffd61 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:23.426940 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b6d8bb34-0d57-4020-a0c4-13986cfffd61 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:23.427693 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b6d8bb34-0d57-4020-a0c4-13986cfffd61 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:23.428501 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b6d8bb34-0d57-4020-a0c4-13986cfffd61 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:23.432344 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:09:23.575969 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-b6d8bb34-0d57-4020-a0c4-13986cfffd61 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:23.587396 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-b6d8bb34-0d57-4020-a0c4-13986cfffd61 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:23.589694 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-b6d8bb34-0d57-4020-a0c4-13986cfffd61 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:23.591456 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b6d8bb34-0d57-4020-a0c4-13986cfffd61 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1722 microversion: 2.20 time: 0.187877 Aug 31 13:09:23.592038 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 399/814] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:09:23 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:09:23.614515 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-2633c040-8bba-4b47-9a9b-8e502854d5fe tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:23.614985 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-2633c040-8bba-4b47-9a9b-8e502854d5fe tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 49803c3f-e096-4c19-a579-3224e6fe2809] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:23.621746 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2633c040-8bba-4b47-9a9b-8e502854d5fe tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:23.622226 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2633c040-8bba-4b47-9a9b-8e502854d5fe tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:23.622646 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2633c040-8bba-4b47-9a9b-8e502854d5fe tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:23.623352 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2633c040-8bba-4b47-9a9b-8e502854d5fe tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:23.623793 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2633c040-8bba-4b47-9a9b-8e502854d5fe tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:23.624316 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2633c040-8bba-4b47-9a9b-8e502854d5fe tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:23.639639 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.wsgi [None req-2633c040-8bba-4b47-9a9b-8e502854d5fe tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] HTTP exception thrown: Instance 49803c3f-e096-4c19-a579-3224e6fe2809 could not be found. Aug 31 13:09:23.641396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-2633c040-8bba-4b47-9a9b-8e502854d5fe tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Request method failure captured: Aug 31 13:09:23.641396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: request: DELETE /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809 HTTP/1.1 Aug 31 13:09:23.641396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept: application/json Aug 31 13:09:23.641396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept-Encoding: identity Aug 31 13:09:23.641396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Connection: close Aug 31 13:09:23.641396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Length: 0 Aug 31 13:09:23.641396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Type: application/json Aug 31 13:09:23.641396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Host: 10.222.0.58 Aug 31 13:09:23.641396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Openstack-System-Scope: None Aug 31 13:09:23.641396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: User-Agent: python-urllib3/1.26.12 Aug 31 13:09:23.641396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Auth-Token: gAAAAABjD1seB5V-6Thim3iLBWgY6MZJsNXtjUZevzsLJVZ2NIiotfWIMtCtM4e6lfRHB222sjqzTtrnMO5z2WuJJHzUrBuHBLZK48wTJdmWU766QD_VCAlvS0b0famMH1kFEYrnHSShDM2yU5Kn_FtAJqWs7GunEyKuLclhv9wwGfMN0wYYABk Aug 31 13:09:23.641396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Id: None Aug 31 13:09:23.641396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Name: None Aug 31 13:09:23.641396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Identity-Status: Confirmed Aug 31 13:09:23.641396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Is-Admin-Project: True Aug 31 13:09:23.641396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Id: default Aug 31 13:09:23.641396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Name: Default Aug 31 13:09:23.641396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Id: 58fa7489cdff42fcb41727a407a110a4 Aug 31 13:09:23.641396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Name: tempest-AttachVolumeTestJSON-865036811 Aug 31 13:09:23.641396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Role: member,reader Aug 31 13:09:23.641396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Roles: member,reader Aug 31 13:09:23.643000 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_58fa7489cdff42fcb41727a407a110a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/58fa7489cdff42fcb41727a407a110a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/58fa7489cdff42fcb41727a407a110a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/58fa7489cdff42fcb41727a407a110a4"}]}] Aug 31 13:09:23.643000 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant: tempest-AttachVolumeTestJSON-865036811 Aug 31 13:09:23.643000 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Id: 58fa7489cdff42fcb41727a407a110a4 Aug 31 13:09:23.643000 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Name: tempest-AttachVolumeTestJSON-865036811 Aug 31 13:09:23.643000 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User: tempest-AttachVolumeTestJSON-865036811-project Aug 31 13:09:23.643000 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Id: default Aug 31 13:09:23.643000 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Name: Default Aug 31 13:09:23.643000 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Id: 65b1d441346f482e9981b1fa4015ea63 Aug 31 13:09:23.643000 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Name: tempest-AttachVolumeTestJSON-865036811-project Aug 31 13:09:23.643000 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: method: > Aug 31 13:09:23.643000 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: exception: Instance 49803c3f-e096-4c19-a579-3224e6fe2809 could not be found. Aug 31 13:09:23.643000 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: action_args: {'id': '49803c3f-e096-4c19-a579-3224e6fe2809'} Aug 31 13:09:23.643772 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:09:23.643772 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:09:23.643772 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 13:09:23.643772 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 13:09:23.643772 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 13:09:23.643772 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 13:09:23.643772 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 13:09:23.643772 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 13:09:23.643772 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 13:09:23.643772 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 13:09:23.643772 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49803c3f-e096-4c19-a579-3224e6fe2809 could not be found. Aug 31 13:09:23.643772 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:09:23.643772 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:09:23.643772 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:09:23.643772 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:09:23.643772 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:09:23.643772 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:09:23.643772 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:09:23.643772 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:09:23.643772 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:09:23.645294 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:09:23.645294 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 13:09:23.645294 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 13:09:23.645294 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 13:09:23.645294 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 13:09:23.645294 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 13:09:23.645294 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 13:09:23.645294 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 13:09:23.645294 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 13:09:23.645294 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49803c3f-e096-4c19-a579-3224e6fe2809 could not be found. Aug 31 13:09:23.645294 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:09:23.645294 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:09:23.645294 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:09:23.645294 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:09:23.645294 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:09:23.645294 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:09:23.645294 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:09:23.645294 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:09:23.645294 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49803c3f-e096-4c19-a579-3224e6fe2809 could not be found. Aug 31 13:09:23.645294 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:09:23.646861 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-2633c040-8bba-4b47-9a9b-8e502854d5fe tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Returning 404 to user: Instance 49803c3f-e096-4c19-a579-3224e6fe2809 could not be found. {{(pid=120704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:09:23.646861 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-2633c040-8bba-4b47-9a9b-8e502854d5fe tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "DELETE /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809" status: 404 len: 111 microversion: 2.1 time: 0.032324 Aug 31 13:09:23.646861 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 416/815] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 31 13:09:23 2022] DELETE /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:09:23.653470 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-dc8ddf4c-6d11-46a9-b405-c4c3713a860d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:23.654713 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-dc8ddf4c-6d11-46a9-b405-c4c3713a860d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 49803c3f-e096-4c19-a579-3224e6fe2809] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:23.663677 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dc8ddf4c-6d11-46a9-b405-c4c3713a860d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:23.664209 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dc8ddf4c-6d11-46a9-b405-c4c3713a860d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:23.664646 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dc8ddf4c-6d11-46a9-b405-c4c3713a860d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:23.665335 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dc8ddf4c-6d11-46a9-b405-c4c3713a860d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:23.665782 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dc8ddf4c-6d11-46a9-b405-c4c3713a860d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:23.666214 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-dc8ddf4c-6d11-46a9-b405-c4c3713a860d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:23.679793 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-dc8ddf4c-6d11-46a9-b405-c4c3713a860d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] HTTP exception thrown: Instance 49803c3f-e096-4c19-a579-3224e6fe2809 could not be found. Aug 31 13:09:23.681332 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-dc8ddf4c-6d11-46a9-b405-c4c3713a860d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Request method failure captured: Aug 31 13:09:23.681332 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: request: GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809 HTTP/1.1 Aug 31 13:09:23.681332 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 31 13:09:23.681332 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 31 13:09:23.681332 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Connection: close Aug 31 13:09:23.681332 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 31 13:09:23.681332 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 31 13:09:23.681332 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Host: 10.222.0.58 Aug 31 13:09:23.681332 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 31 13:09:23.681332 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 31 13:09:23.681332 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjD1seB5V-6Thim3iLBWgY6MZJsNXtjUZevzsLJVZ2NIiotfWIMtCtM4e6lfRHB222sjqzTtrnMO5z2WuJJHzUrBuHBLZK48wTJdmWU766QD_VCAlvS0b0famMH1kFEYrnHSShDM2yU5Kn_FtAJqWs7GunEyKuLclhv9wwGfMN0wYYABk Aug 31 13:09:23.681332 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 31 13:09:23.681332 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 31 13:09:23.681332 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 31 13:09:23.681332 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 31 13:09:23.681332 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 31 13:09:23.681332 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 31 13:09:23.681332 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Id: 58fa7489cdff42fcb41727a407a110a4 Aug 31 13:09:23.681332 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-AttachVolumeTestJSON-865036811 Aug 31 13:09:23.681332 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Role: member,reader Aug 31 13:09:23.681332 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Roles: member,reader Aug 31 13:09:23.685052 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_58fa7489cdff42fcb41727a407a110a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/58fa7489cdff42fcb41727a407a110a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/58fa7489cdff42fcb41727a407a110a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/58fa7489cdff42fcb41727a407a110a4"}]}] Aug 31 13:09:23.685052 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-AttachVolumeTestJSON-865036811 Aug 31 13:09:23.685052 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant-Id: 58fa7489cdff42fcb41727a407a110a4 Aug 31 13:09:23.685052 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-AttachVolumeTestJSON-865036811 Aug 31 13:09:23.685052 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User: tempest-AttachVolumeTestJSON-865036811-project Aug 31 13:09:23.685052 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 31 13:09:23.685052 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 31 13:09:23.685052 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Id: 65b1d441346f482e9981b1fa4015ea63 Aug 31 13:09:23.685052 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-AttachVolumeTestJSON-865036811-project Aug 31 13:09:23.685052 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: method: > Aug 31 13:09:23.685052 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: exception: Instance 49803c3f-e096-4c19-a579-3224e6fe2809 could not be found. Aug 31 13:09:23.685052 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: action_args: {'id': '49803c3f-e096-4c19-a579-3224e6fe2809'} Aug 31 13:09:23.685898 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:09:23.685898 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:09:23.685898 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 13:09:23.685898 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 13:09:23.685898 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 13:09:23.685898 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 13:09:23.685898 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 13:09:23.685898 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 13:09:23.685898 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 13:09:23.685898 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 13:09:23.685898 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49803c3f-e096-4c19-a579-3224e6fe2809 could not be found. Aug 31 13:09:23.685898 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:09:23.685898 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:09:23.685898 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:09:23.685898 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:09:23.685898 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:09:23.685898 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:09:23.685898 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:09:23.685898 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:09:23.685898 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:09:23.687470 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:09:23.687470 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 13:09:23.687470 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 13:09:23.687470 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 13:09:23.687470 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 13:09:23.687470 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 13:09:23.687470 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 13:09:23.687470 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49803c3f-e096-4c19-a579-3224e6fe2809 could not be found. Aug 31 13:09:23.687470 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:09:23.687470 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:09:23.687470 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:09:23.687470 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:09:23.687470 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:09:23.687470 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:09:23.687470 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:09:23.687470 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:09:23.687470 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49803c3f-e096-4c19-a579-3224e6fe2809 could not be found. Aug 31 13:09:23.687470 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:09:23.688817 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-dc8ddf4c-6d11-46a9-b405-c4c3713a860d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Returning 404 to user: Instance 49803c3f-e096-4c19-a579-3224e6fe2809 could not be found. {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:09:23.688817 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-dc8ddf4c-6d11-46a9-b405-c4c3713a860d tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809" status: 404 len: 111 microversion: 2.1 time: 0.035281 Aug 31 13:09:23.688817 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 400/816] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:09:23 2022] GET /compute/v2.1/servers/49803c3f-e096-4c19-a579-3224e6fe2809 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:09:24.618836 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-c2fda4bb-53c6-4e92-8243-2e37eba6058a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:24.619377 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-c2fda4bb-53c6-4e92-8243-2e37eba6058a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:24.622363 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:09:24.628383 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c2fda4bb-53c6-4e92-8243-2e37eba6058a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:24.628916 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c2fda4bb-53c6-4e92-8243-2e37eba6058a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:24.629402 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c2fda4bb-53c6-4e92-8243-2e37eba6058a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:24.630132 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c2fda4bb-53c6-4e92-8243-2e37eba6058a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:24.630621 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c2fda4bb-53c6-4e92-8243-2e37eba6058a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:24.631041 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c2fda4bb-53c6-4e92-8243-2e37eba6058a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:24.636403 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:09:24.779597 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-c2fda4bb-53c6-4e92-8243-2e37eba6058a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:24.792890 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-c2fda4bb-53c6-4e92-8243-2e37eba6058a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:24.794718 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-c2fda4bb-53c6-4e92-8243-2e37eba6058a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:24.796880 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-c2fda4bb-53c6-4e92-8243-2e37eba6058a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1722 microversion: 2.20 time: 0.184105 Aug 31 13:09:24.812565 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 417/817] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:09:24 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:09:24.831661 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-261292df-60df-414c-b9f7-1c3b3ea6ab99 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:24.832181 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-261292df-60df-414c-b9f7-1c3b3ea6ab99 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:24.839868 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-261292df-60df-414c-b9f7-1c3b3ea6ab99 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:24.840338 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-261292df-60df-414c-b9f7-1c3b3ea6ab99 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:24.840763 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-261292df-60df-414c-b9f7-1c3b3ea6ab99 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:24.842029 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-261292df-60df-414c-b9f7-1c3b3ea6ab99 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:24.842029 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-261292df-60df-414c-b9f7-1c3b3ea6ab99 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:24.842297 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-261292df-60df-414c-b9f7-1c3b3ea6ab99 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:24.856134 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-261292df-60df-414c-b9f7-1c3b3ea6ab99 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] HTTP exception thrown: Instance 48f08cc0-15cb-4884-960b-a96396a0d4bf could not be found. Aug 31 13:09:24.857664 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-261292df-60df-414c-b9f7-1c3b3ea6ab99 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Request method failure captured: Aug 31 13:09:24.857664 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: request: DELETE /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf HTTP/1.1 Aug 31 13:09:24.857664 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 31 13:09:24.857664 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 31 13:09:24.857664 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Connection: close Aug 31 13:09:24.857664 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 31 13:09:24.857664 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 31 13:09:24.857664 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Host: 10.222.0.58 Aug 31 13:09:24.857664 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 31 13:09:24.857664 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 31 13:09:24.857664 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjD1seB5V-6Thim3iLBWgY6MZJsNXtjUZevzsLJVZ2NIiotfWIMtCtM4e6lfRHB222sjqzTtrnMO5z2WuJJHzUrBuHBLZK48wTJdmWU766QD_VCAlvS0b0famMH1kFEYrnHSShDM2yU5Kn_FtAJqWs7GunEyKuLclhv9wwGfMN0wYYABk Aug 31 13:09:24.857664 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 31 13:09:24.857664 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 31 13:09:24.857664 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 31 13:09:24.857664 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 31 13:09:24.857664 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 31 13:09:24.857664 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 31 13:09:24.857664 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Id: 58fa7489cdff42fcb41727a407a110a4 Aug 31 13:09:24.857664 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-AttachVolumeTestJSON-865036811 Aug 31 13:09:24.857664 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Role: member,reader Aug 31 13:09:24.857664 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Roles: member,reader Aug 31 13:09:24.859250 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_58fa7489cdff42fcb41727a407a110a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/58fa7489cdff42fcb41727a407a110a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/58fa7489cdff42fcb41727a407a110a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/58fa7489cdff42fcb41727a407a110a4"}]}] Aug 31 13:09:24.859250 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-AttachVolumeTestJSON-865036811 Aug 31 13:09:24.859250 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant-Id: 58fa7489cdff42fcb41727a407a110a4 Aug 31 13:09:24.859250 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-AttachVolumeTestJSON-865036811 Aug 31 13:09:24.859250 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User: tempest-AttachVolumeTestJSON-865036811-project Aug 31 13:09:24.859250 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 31 13:09:24.859250 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 31 13:09:24.859250 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Id: 65b1d441346f482e9981b1fa4015ea63 Aug 31 13:09:24.859250 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-AttachVolumeTestJSON-865036811-project Aug 31 13:09:24.859250 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: method: > Aug 31 13:09:24.859250 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: exception: Instance 48f08cc0-15cb-4884-960b-a96396a0d4bf could not be found. Aug 31 13:09:24.859250 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: action_args: {'id': '48f08cc0-15cb-4884-960b-a96396a0d4bf'} Aug 31 13:09:24.860145 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:09:24.860145 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:09:24.860145 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 13:09:24.860145 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 13:09:24.860145 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 13:09:24.860145 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 13:09:24.860145 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 13:09:24.860145 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 13:09:24.860145 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 13:09:24.860145 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 13:09:24.860145 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48f08cc0-15cb-4884-960b-a96396a0d4bf could not be found. Aug 31 13:09:24.860145 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:09:24.860145 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:09:24.860145 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:09:24.860145 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:09:24.860145 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:09:24.860145 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:09:24.860145 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:09:24.860145 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:09:24.860145 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:09:24.861391 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:09:24.861391 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 13:09:24.861391 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 13:09:24.861391 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 13:09:24.861391 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 13:09:24.861391 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 13:09:24.861391 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 13:09:24.861391 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 13:09:24.861391 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 13:09:24.861391 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48f08cc0-15cb-4884-960b-a96396a0d4bf could not be found. Aug 31 13:09:24.861391 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:09:24.861391 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:09:24.861391 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:09:24.861391 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:09:24.861391 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:09:24.861391 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:09:24.861391 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:09:24.861391 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:09:24.861391 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48f08cc0-15cb-4884-960b-a96396a0d4bf could not be found. Aug 31 13:09:24.861391 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:09:24.862583 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-261292df-60df-414c-b9f7-1c3b3ea6ab99 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Returning 404 to user: Instance 48f08cc0-15cb-4884-960b-a96396a0d4bf could not be found. {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:09:24.862583 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-261292df-60df-414c-b9f7-1c3b3ea6ab99 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "DELETE /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 404 len: 111 microversion: 2.1 time: 0.033488 Aug 31 13:09:24.862583 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 401/818] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 31 13:09:24 2022] DELETE /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:09:24.868144 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-861b878a-dbab-402e-95c7-a51816381222 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:24.868752 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-861b878a-dbab-402e-95c7-a51816381222 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] [instance: 48f08cc0-15cb-4884-960b-a96396a0d4bf] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:24.874960 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-861b878a-dbab-402e-95c7-a51816381222 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:24.875424 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-861b878a-dbab-402e-95c7-a51816381222 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:24.875934 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-861b878a-dbab-402e-95c7-a51816381222 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:24.876682 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-861b878a-dbab-402e-95c7-a51816381222 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:24.877098 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-861b878a-dbab-402e-95c7-a51816381222 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:24.877513 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-861b878a-dbab-402e-95c7-a51816381222 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:24.890692 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.wsgi [None req-861b878a-dbab-402e-95c7-a51816381222 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] HTTP exception thrown: Instance 48f08cc0-15cb-4884-960b-a96396a0d4bf could not be found. Aug 31 13:09:24.892224 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-861b878a-dbab-402e-95c7-a51816381222 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Request method failure captured: Aug 31 13:09:24.892224 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: request: GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf HTTP/1.1 Aug 31 13:09:24.892224 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept: application/json Aug 31 13:09:24.892224 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept-Encoding: identity Aug 31 13:09:24.892224 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Connection: close Aug 31 13:09:24.892224 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Length: 0 Aug 31 13:09:24.892224 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Type: application/json Aug 31 13:09:24.892224 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Host: 10.222.0.58 Aug 31 13:09:24.892224 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Openstack-System-Scope: None Aug 31 13:09:24.892224 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: User-Agent: python-urllib3/1.26.12 Aug 31 13:09:24.892224 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Auth-Token: gAAAAABjD1seB5V-6Thim3iLBWgY6MZJsNXtjUZevzsLJVZ2NIiotfWIMtCtM4e6lfRHB222sjqzTtrnMO5z2WuJJHzUrBuHBLZK48wTJdmWU766QD_VCAlvS0b0famMH1kFEYrnHSShDM2yU5Kn_FtAJqWs7GunEyKuLclhv9wwGfMN0wYYABk Aug 31 13:09:24.892224 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Id: None Aug 31 13:09:24.892224 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Name: None Aug 31 13:09:24.892224 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Identity-Status: Confirmed Aug 31 13:09:24.892224 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Is-Admin-Project: True Aug 31 13:09:24.892224 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Id: default Aug 31 13:09:24.892224 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Name: Default Aug 31 13:09:24.892224 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Id: 58fa7489cdff42fcb41727a407a110a4 Aug 31 13:09:24.892224 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Name: tempest-AttachVolumeTestJSON-865036811 Aug 31 13:09:24.892224 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Role: member,reader Aug 31 13:09:24.892224 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Roles: member,reader Aug 31 13:09:24.893687 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_58fa7489cdff42fcb41727a407a110a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/58fa7489cdff42fcb41727a407a110a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/58fa7489cdff42fcb41727a407a110a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/58fa7489cdff42fcb41727a407a110a4"}]}] Aug 31 13:09:24.893687 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant: tempest-AttachVolumeTestJSON-865036811 Aug 31 13:09:24.893687 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Id: 58fa7489cdff42fcb41727a407a110a4 Aug 31 13:09:24.893687 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Name: tempest-AttachVolumeTestJSON-865036811 Aug 31 13:09:24.893687 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User: tempest-AttachVolumeTestJSON-865036811-project Aug 31 13:09:24.893687 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Id: default Aug 31 13:09:24.893687 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Name: Default Aug 31 13:09:24.893687 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Id: 65b1d441346f482e9981b1fa4015ea63 Aug 31 13:09:24.893687 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Name: tempest-AttachVolumeTestJSON-865036811-project Aug 31 13:09:24.893687 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: method: > Aug 31 13:09:24.893687 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: exception: Instance 48f08cc0-15cb-4884-960b-a96396a0d4bf could not be found. Aug 31 13:09:24.893687 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: action_args: {'id': '48f08cc0-15cb-4884-960b-a96396a0d4bf'} Aug 31 13:09:24.894597 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:09:24.894597 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:09:24.894597 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 13:09:24.894597 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 13:09:24.894597 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 13:09:24.894597 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 13:09:24.894597 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 13:09:24.894597 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 13:09:24.894597 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 13:09:24.894597 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 13:09:24.894597 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48f08cc0-15cb-4884-960b-a96396a0d4bf could not be found. Aug 31 13:09:24.894597 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:09:24.894597 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:09:24.894597 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:09:24.894597 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:09:24.894597 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:09:24.894597 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:09:24.894597 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:09:24.894597 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:09:24.894597 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:09:24.896049 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:09:24.896049 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 13:09:24.896049 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 13:09:24.896049 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 13:09:24.896049 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 13:09:24.896049 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 13:09:24.896049 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 13:09:24.896049 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48f08cc0-15cb-4884-960b-a96396a0d4bf could not be found. Aug 31 13:09:24.896049 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:09:24.896049 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:09:24.896049 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:09:24.896049 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:09:24.896049 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:09:24.896049 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:09:24.896049 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:09:24.896049 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:09:24.896049 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48f08cc0-15cb-4884-960b-a96396a0d4bf could not be found. Aug 31 13:09:24.896049 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:09:24.897480 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-861b878a-dbab-402e-95c7-a51816381222 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] Returning 404 to user: Instance 48f08cc0-15cb-4884-960b-a96396a0d4bf could not be found. {{(pid=120704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:09:24.897480 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-861b878a-dbab-402e-95c7-a51816381222 tempest-AttachVolumeTestJSON-865036811 tempest-AttachVolumeTestJSON-865036811-project] 10.222.0.58 "GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf" status: 404 len: 111 microversion: 2.1 time: 0.029510 Aug 31 13:09:24.897480 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 418/819] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:09:24 2022] GET /compute/v2.1/servers/48f08cc0-15cb-4884-960b-a96396a0d4bf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:09:25.823869 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-f032ec5f-f495-4f89-897b-5a0a55289a5f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:25.824502 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-f032ec5f-f495-4f89-897b-5a0a55289a5f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:25.831095 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f032ec5f-f495-4f89-897b-5a0a55289a5f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:25.831580 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f032ec5f-f495-4f89-897b-5a0a55289a5f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:25.832048 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f032ec5f-f495-4f89-897b-5a0a55289a5f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:25.832762 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f032ec5f-f495-4f89-897b-5a0a55289a5f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:25.833212 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f032ec5f-f495-4f89-897b-5a0a55289a5f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:25.833625 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f032ec5f-f495-4f89-897b-5a0a55289a5f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:25.975238 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-f032ec5f-f495-4f89-897b-5a0a55289a5f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:25.984364 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-f032ec5f-f495-4f89-897b-5a0a55289a5f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:25.985950 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-f032ec5f-f495-4f89-897b-5a0a55289a5f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:25.987431 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-f032ec5f-f495-4f89-897b-5a0a55289a5f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1722 microversion: 2.20 time: 0.167638 Aug 31 13:09:26.000056 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 402/820] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:09:25 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:09:27.010595 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-10cc6107-add1-4c39-bb8b-d41f8fb7220b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:27.011420 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-10cc6107-add1-4c39-bb8b-d41f8fb7220b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:27.019750 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-10cc6107-add1-4c39-bb8b-d41f8fb7220b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:27.020355 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-10cc6107-add1-4c39-bb8b-d41f8fb7220b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:27.022634 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-10cc6107-add1-4c39-bb8b-d41f8fb7220b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:27.023587 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-10cc6107-add1-4c39-bb8b-d41f8fb7220b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:27.024146 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-10cc6107-add1-4c39-bb8b-d41f8fb7220b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:27.024642 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-10cc6107-add1-4c39-bb8b-d41f8fb7220b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:27.273897 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-10cc6107-add1-4c39-bb8b-d41f8fb7220b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:27.287042 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-10cc6107-add1-4c39-bb8b-d41f8fb7220b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:27.288701 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-10cc6107-add1-4c39-bb8b-d41f8fb7220b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:27.289976 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-10cc6107-add1-4c39-bb8b-d41f8fb7220b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1722 microversion: 2.20 time: 0.283472 Aug 31 13:09:27.291965 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 419/821] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:09:27 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1722 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:09:28.313092 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-850dfbe9-7556-4f53-87f7-f5f197228285 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:28.313763 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-850dfbe9-7556-4f53-87f7-f5f197228285 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:28.320936 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-850dfbe9-7556-4f53-87f7-f5f197228285 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:28.321448 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-850dfbe9-7556-4f53-87f7-f5f197228285 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:28.321884 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-850dfbe9-7556-4f53-87f7-f5f197228285 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:28.322589 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-850dfbe9-7556-4f53-87f7-f5f197228285 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:28.323016 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-850dfbe9-7556-4f53-87f7-f5f197228285 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:28.323443 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-850dfbe9-7556-4f53-87f7-f5f197228285 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:28.483473 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-850dfbe9-7556-4f53-87f7-f5f197228285 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:28.493474 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-850dfbe9-7556-4f53-87f7-f5f197228285 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:28.495179 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-850dfbe9-7556-4f53-87f7-f5f197228285 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:28.496724 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-850dfbe9-7556-4f53-87f7-f5f197228285 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1722 microversion: 2.20 time: 0.187700 Aug 31 13:09:28.497999 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 403/822] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:09:28 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:09:29.521644 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-0b74eacc-2ed1-4a34-957e-e480f056e04f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:29.522247 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-0b74eacc-2ed1-4a34-957e-e480f056e04f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:29.530578 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0b74eacc-2ed1-4a34-957e-e480f056e04f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:29.531070 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0b74eacc-2ed1-4a34-957e-e480f056e04f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:29.531496 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0b74eacc-2ed1-4a34-957e-e480f056e04f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:29.532217 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0b74eacc-2ed1-4a34-957e-e480f056e04f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:29.532649 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0b74eacc-2ed1-4a34-957e-e480f056e04f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:29.533046 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0b74eacc-2ed1-4a34-957e-e480f056e04f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:29.666150 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-0b74eacc-2ed1-4a34-957e-e480f056e04f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:29.674727 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-0b74eacc-2ed1-4a34-957e-e480f056e04f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:29.676254 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-0b74eacc-2ed1-4a34-957e-e480f056e04f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:29.677402 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-0b74eacc-2ed1-4a34-957e-e480f056e04f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1722 microversion: 2.20 time: 0.160069 Aug 31 13:09:29.677958 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 420/823] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:09:29 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:09:30.700144 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-2c1e5e80-c2fe-4b56-a8df-1cc37ee4a95a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:30.701468 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-2c1e5e80-c2fe-4b56-a8df-1cc37ee4a95a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:30.709292 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2c1e5e80-c2fe-4b56-a8df-1cc37ee4a95a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:30.710226 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2c1e5e80-c2fe-4b56-a8df-1cc37ee4a95a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:30.717495 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2c1e5e80-c2fe-4b56-a8df-1cc37ee4a95a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:30.718307 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2c1e5e80-c2fe-4b56-a8df-1cc37ee4a95a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:30.719012 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2c1e5e80-c2fe-4b56-a8df-1cc37ee4a95a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:30.719583 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2c1e5e80-c2fe-4b56-a8df-1cc37ee4a95a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:30.855836 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-2c1e5e80-c2fe-4b56-a8df-1cc37ee4a95a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:30.864293 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-2c1e5e80-c2fe-4b56-a8df-1cc37ee4a95a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:30.865929 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-2c1e5e80-c2fe-4b56-a8df-1cc37ee4a95a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:30.867340 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-2c1e5e80-c2fe-4b56-a8df-1cc37ee4a95a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1743 microversion: 2.20 time: 0.171323 Aug 31 13:09:30.868009 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 404/824] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:09:30 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1743 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:09:31.890414 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-313a991b-15d6-4b8e-aa5b-0e92df7a915e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:31.891037 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-313a991b-15d6-4b8e-aa5b-0e92df7a915e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:31.897654 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-313a991b-15d6-4b8e-aa5b-0e92df7a915e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:31.898181 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-313a991b-15d6-4b8e-aa5b-0e92df7a915e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:31.898645 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-313a991b-15d6-4b8e-aa5b-0e92df7a915e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:31.899334 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-313a991b-15d6-4b8e-aa5b-0e92df7a915e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:31.899779 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-313a991b-15d6-4b8e-aa5b-0e92df7a915e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:31.900220 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-313a991b-15d6-4b8e-aa5b-0e92df7a915e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:32.032770 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-313a991b-15d6-4b8e-aa5b-0e92df7a915e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:32.041207 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-313a991b-15d6-4b8e-aa5b-0e92df7a915e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:32.042650 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-313a991b-15d6-4b8e-aa5b-0e92df7a915e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:32.043835 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-313a991b-15d6-4b8e-aa5b-0e92df7a915e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1743 microversion: 2.20 time: 0.157334 Aug 31 13:09:32.044417 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 421/825] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:09:31 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:09:33.066809 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-0ae21e05-4db5-4ea8-8288-c46758cd6b76 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:33.067410 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-0ae21e05-4db5-4ea8-8288-c46758cd6b76 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:33.074120 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0ae21e05-4db5-4ea8-8288-c46758cd6b76 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:33.074598 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0ae21e05-4db5-4ea8-8288-c46758cd6b76 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:33.075030 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0ae21e05-4db5-4ea8-8288-c46758cd6b76 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:33.075711 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0ae21e05-4db5-4ea8-8288-c46758cd6b76 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:33.076187 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0ae21e05-4db5-4ea8-8288-c46758cd6b76 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:33.076626 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0ae21e05-4db5-4ea8-8288-c46758cd6b76 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:33.219094 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-0ae21e05-4db5-4ea8-8288-c46758cd6b76 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:33.227435 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-0ae21e05-4db5-4ea8-8288-c46758cd6b76 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:33.228988 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-0ae21e05-4db5-4ea8-8288-c46758cd6b76 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:33.230270 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-0ae21e05-4db5-4ea8-8288-c46758cd6b76 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1743 microversion: 2.20 time: 0.167472 Aug 31 13:09:33.230832 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 405/826] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:09:33 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1743 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:09:33.314223 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-19cb4b43-8cb6-4230-b523-2531dc7b5c0f req-db33c2a5-fa19-412d-9ea9-63d6448d4087 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21c9e3cb-e5b1-428d-8405-ec33632c5f3d", "name": "network-vif-plugged", "status": "completed", "tag": "b32c3e63-7e7a-4bf8-bf81-80a7acf17f63"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:09:33.325611 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-19cb4b43-8cb6-4230-b523-2531dc7b5c0f req-db33c2a5-fa19-412d-9ea9-63d6448d4087 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:33.326082 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-19cb4b43-8cb6-4230-b523-2531dc7b5c0f req-db33c2a5-fa19-412d-9ea9-63d6448d4087 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:33.326500 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-19cb4b43-8cb6-4230-b523-2531dc7b5c0f req-db33c2a5-fa19-412d-9ea9-63d6448d4087 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:33.338427 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-19cb4b43-8cb6-4230-b523-2531dc7b5c0f req-db33c2a5-fa19-412d-9ea9-63d6448d4087 service nova] Creating event network-vif-plugged:b32c3e63-7e7a-4bf8-bf81-80a7acf17f63 for instance 21c9e3cb-e5b1-428d-8405-ec33632c5f3d on hv-cinder-85442 Aug 31 13:09:33.343481 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-19cb4b43-8cb6-4230-b523-2531dc7b5c0f req-db33c2a5-fa19-412d-9ea9-63d6448d4087 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033000 Aug 31 13:09:33.344546 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 422/827] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:09:34.256256 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-6633ca8a-7e2f-4acc-afbb-1b4359a8f1b7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:34.256848 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-6633ca8a-7e2f-4acc-afbb-1b4359a8f1b7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:34.265111 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6633ca8a-7e2f-4acc-afbb-1b4359a8f1b7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:34.265615 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6633ca8a-7e2f-4acc-afbb-1b4359a8f1b7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:34.266046 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6633ca8a-7e2f-4acc-afbb-1b4359a8f1b7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:34.266738 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6633ca8a-7e2f-4acc-afbb-1b4359a8f1b7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:34.267235 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6633ca8a-7e2f-4acc-afbb-1b4359a8f1b7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:34.267584 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6633ca8a-7e2f-4acc-afbb-1b4359a8f1b7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:34.402968 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-6633ca8a-7e2f-4acc-afbb-1b4359a8f1b7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:34.411425 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-6633ca8a-7e2f-4acc-afbb-1b4359a8f1b7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:34.412904 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-6633ca8a-7e2f-4acc-afbb-1b4359a8f1b7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:34.414751 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-6633ca8a-7e2f-4acc-afbb-1b4359a8f1b7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1743 microversion: 2.20 time: 0.164922 Aug 31 13:09:34.415331 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 406/828] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:09:34 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1743 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:09:35.441670 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-d7aa48e7-8353-4ed9-b386-61d3be4d1ad2 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:35.442684 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-d7aa48e7-8353-4ed9-b386-61d3be4d1ad2 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:35.452143 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d7aa48e7-8353-4ed9-b386-61d3be4d1ad2 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:35.452629 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d7aa48e7-8353-4ed9-b386-61d3be4d1ad2 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:35.453055 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d7aa48e7-8353-4ed9-b386-61d3be4d1ad2 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:35.453781 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d7aa48e7-8353-4ed9-b386-61d3be4d1ad2 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:35.454214 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d7aa48e7-8353-4ed9-b386-61d3be4d1ad2 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:35.454638 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d7aa48e7-8353-4ed9-b386-61d3be4d1ad2 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:35.610350 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-d7aa48e7-8353-4ed9-b386-61d3be4d1ad2 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:35.620705 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-d7aa48e7-8353-4ed9-b386-61d3be4d1ad2 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:35.622150 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-d7aa48e7-8353-4ed9-b386-61d3be4d1ad2 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:35.623388 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-d7aa48e7-8353-4ed9-b386-61d3be4d1ad2 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1743 microversion: 2.20 time: 0.188864 Aug 31 13:09:35.623996 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 423/829] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:09:35 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1743 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:09:36.646579 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-d2c494a6-674b-44c8-8a4b-5f225fcc0ec3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:36.648164 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-d2c494a6-674b-44c8-8a4b-5f225fcc0ec3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:36.656083 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d2c494a6-674b-44c8-8a4b-5f225fcc0ec3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:36.656596 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d2c494a6-674b-44c8-8a4b-5f225fcc0ec3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:36.657027 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d2c494a6-674b-44c8-8a4b-5f225fcc0ec3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:36.657935 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d2c494a6-674b-44c8-8a4b-5f225fcc0ec3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:36.658577 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d2c494a6-674b-44c8-8a4b-5f225fcc0ec3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:36.659003 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d2c494a6-674b-44c8-8a4b-5f225fcc0ec3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:36.813618 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-d2c494a6-674b-44c8-8a4b-5f225fcc0ec3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:36.822140 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-d2c494a6-674b-44c8-8a4b-5f225fcc0ec3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:36.823861 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-d2c494a6-674b-44c8-8a4b-5f225fcc0ec3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:36.825149 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-d2c494a6-674b-44c8-8a4b-5f225fcc0ec3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1738 microversion: 2.20 time: 0.182529 Aug 31 13:09:36.825826 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 407/830] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:09:36 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:09:37.849228 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-4290ee44-acdf-43cf-91be-7fa56b383463 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:37.849832 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-4290ee44-acdf-43cf-91be-7fa56b383463 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:37.856719 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4290ee44-acdf-43cf-91be-7fa56b383463 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:37.857421 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4290ee44-acdf-43cf-91be-7fa56b383463 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:37.858029 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4290ee44-acdf-43cf-91be-7fa56b383463 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:37.858893 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4290ee44-acdf-43cf-91be-7fa56b383463 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:37.859494 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4290ee44-acdf-43cf-91be-7fa56b383463 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:37.860101 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4290ee44-acdf-43cf-91be-7fa56b383463 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:38.035396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-4290ee44-acdf-43cf-91be-7fa56b383463 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:38.046774 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-4290ee44-acdf-43cf-91be-7fa56b383463 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:38.048227 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-4290ee44-acdf-43cf-91be-7fa56b383463 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:38.049839 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-4290ee44-acdf-43cf-91be-7fa56b383463 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1738 microversion: 2.20 time: 0.204530 Aug 31 13:09:38.051098 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 424/831] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:09:37 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1738 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:09:39.079228 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-bd8390e5-aa00-467a-8bd0-8c778c7edae7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:39.079949 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-bd8390e5-aa00-467a-8bd0-8c778c7edae7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:39.099417 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bd8390e5-aa00-467a-8bd0-8c778c7edae7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:39.099959 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bd8390e5-aa00-467a-8bd0-8c778c7edae7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:39.100419 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bd8390e5-aa00-467a-8bd0-8c778c7edae7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:39.101199 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bd8390e5-aa00-467a-8bd0-8c778c7edae7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:39.101653 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bd8390e5-aa00-467a-8bd0-8c778c7edae7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:39.102250 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bd8390e5-aa00-467a-8bd0-8c778c7edae7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:39.298125 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-bd8390e5-aa00-467a-8bd0-8c778c7edae7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:39.309698 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-bd8390e5-aa00-467a-8bd0-8c778c7edae7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:39.314805 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-bd8390e5-aa00-467a-8bd0-8c778c7edae7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:39.316631 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-bd8390e5-aa00-467a-8bd0-8c778c7edae7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1738 microversion: 2.20 time: 0.243691 Aug 31 13:09:39.331011 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 408/832] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:09:39 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1738 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:09:40.344762 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-6f1db160-4e41-4ca4-b6ca-ccb40563ba7d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:40.346489 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-6f1db160-4e41-4ca4-b6ca-ccb40563ba7d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:40.356123 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6f1db160-4e41-4ca4-b6ca-ccb40563ba7d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:40.356638 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6f1db160-4e41-4ca4-b6ca-ccb40563ba7d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:40.357073 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6f1db160-4e41-4ca4-b6ca-ccb40563ba7d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:40.357779 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6f1db160-4e41-4ca4-b6ca-ccb40563ba7d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:40.358230 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6f1db160-4e41-4ca4-b6ca-ccb40563ba7d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:40.358650 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6f1db160-4e41-4ca4-b6ca-ccb40563ba7d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:40.501231 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-6f1db160-4e41-4ca4-b6ca-ccb40563ba7d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:40.510840 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-6f1db160-4e41-4ca4-b6ca-ccb40563ba7d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:40.512452 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-6f1db160-4e41-4ca4-b6ca-ccb40563ba7d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:40.513775 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-6f1db160-4e41-4ca4-b6ca-ccb40563ba7d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1738 microversion: 2.20 time: 0.173555 Aug 31 13:09:40.514439 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 425/833] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:09:40 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:09:41.538491 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-d1ed2aec-6ff8-4da6-8d33-fbcc56ddfa02 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:41.539217 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-d1ed2aec-6ff8-4da6-8d33-fbcc56ddfa02 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:41.546312 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d1ed2aec-6ff8-4da6-8d33-fbcc56ddfa02 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:41.547181 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d1ed2aec-6ff8-4da6-8d33-fbcc56ddfa02 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:41.547630 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d1ed2aec-6ff8-4da6-8d33-fbcc56ddfa02 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:41.548400 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d1ed2aec-6ff8-4da6-8d33-fbcc56ddfa02 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:41.548840 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d1ed2aec-6ff8-4da6-8d33-fbcc56ddfa02 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:41.549313 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d1ed2aec-6ff8-4da6-8d33-fbcc56ddfa02 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:41.698029 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-d1ed2aec-6ff8-4da6-8d33-fbcc56ddfa02 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:41.706329 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-d1ed2aec-6ff8-4da6-8d33-fbcc56ddfa02 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:41.707848 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-d1ed2aec-6ff8-4da6-8d33-fbcc56ddfa02 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:41.709301 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-d1ed2aec-6ff8-4da6-8d33-fbcc56ddfa02 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1738 microversion: 2.20 time: 0.175637 Aug 31 13:09:41.724248 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 409/834] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:09:41 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1738 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:09:42.734283 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-aff989a7-13ed-46ca-aad1-81337355aa9e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:42.735562 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-aff989a7-13ed-46ca-aad1-81337355aa9e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:42.745345 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-aff989a7-13ed-46ca-aad1-81337355aa9e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:42.746164 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-aff989a7-13ed-46ca-aad1-81337355aa9e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:42.746704 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-aff989a7-13ed-46ca-aad1-81337355aa9e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:42.747477 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-aff989a7-13ed-46ca-aad1-81337355aa9e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:42.748028 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-aff989a7-13ed-46ca-aad1-81337355aa9e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:42.748641 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-aff989a7-13ed-46ca-aad1-81337355aa9e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:42.901860 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-aff989a7-13ed-46ca-aad1-81337355aa9e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:42.910754 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-aff989a7-13ed-46ca-aad1-81337355aa9e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:42.912216 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-aff989a7-13ed-46ca-aad1-81337355aa9e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:42.913388 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-aff989a7-13ed-46ca-aad1-81337355aa9e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1738 microversion: 2.20 time: 0.184204 Aug 31 13:09:42.914455 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 426/835] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:09:42 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:09:43.943225 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-51d68910-b658-420a-a0f1-8d0496230a7f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:43.943868 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-51d68910-b658-420a-a0f1-8d0496230a7f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:43.950786 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-51d68910-b658-420a-a0f1-8d0496230a7f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:43.951359 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-51d68910-b658-420a-a0f1-8d0496230a7f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:43.951886 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-51d68910-b658-420a-a0f1-8d0496230a7f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:43.952664 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-51d68910-b658-420a-a0f1-8d0496230a7f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:43.953320 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-51d68910-b658-420a-a0f1-8d0496230a7f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:43.953894 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-51d68910-b658-420a-a0f1-8d0496230a7f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:44.115311 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-51d68910-b658-420a-a0f1-8d0496230a7f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:44.137172 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-51d68910-b658-420a-a0f1-8d0496230a7f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:44.138984 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-51d68910-b658-420a-a0f1-8d0496230a7f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:44.143613 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-51d68910-b658-420a-a0f1-8d0496230a7f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1738 microversion: 2.20 time: 0.209205 Aug 31 13:09:44.144487 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 410/836] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:09:43 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1738 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:09:45.168815 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-8bde426b-a6e7-4dc5-add3-f6ae01d51d7f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:45.169578 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-8bde426b-a6e7-4dc5-add3-f6ae01d51d7f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:45.177270 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8bde426b-a6e7-4dc5-add3-f6ae01d51d7f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:45.177798 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8bde426b-a6e7-4dc5-add3-f6ae01d51d7f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:45.178257 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8bde426b-a6e7-4dc5-add3-f6ae01d51d7f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:45.178982 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8bde426b-a6e7-4dc5-add3-f6ae01d51d7f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:45.179456 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8bde426b-a6e7-4dc5-add3-f6ae01d51d7f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:45.179924 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8bde426b-a6e7-4dc5-add3-f6ae01d51d7f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:45.326524 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-8bde426b-a6e7-4dc5-add3-f6ae01d51d7f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:45.335584 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-8bde426b-a6e7-4dc5-add3-f6ae01d51d7f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:45.337124 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-8bde426b-a6e7-4dc5-add3-f6ae01d51d7f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:45.338880 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-8bde426b-a6e7-4dc5-add3-f6ae01d51d7f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1738 microversion: 2.20 time: 0.174764 Aug 31 13:09:45.339461 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 427/837] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:09:45 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:09:46.362550 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-bc8fa6ef-64fe-4183-95a4-e718361eab10 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:46.365763 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-bc8fa6ef-64fe-4183-95a4-e718361eab10 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:46.373672 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bc8fa6ef-64fe-4183-95a4-e718361eab10 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:46.374483 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bc8fa6ef-64fe-4183-95a4-e718361eab10 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:46.375198 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bc8fa6ef-64fe-4183-95a4-e718361eab10 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:46.376117 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bc8fa6ef-64fe-4183-95a4-e718361eab10 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:46.376783 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bc8fa6ef-64fe-4183-95a4-e718361eab10 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:46.377454 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bc8fa6ef-64fe-4183-95a4-e718361eab10 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:46.535575 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-bc8fa6ef-64fe-4183-95a4-e718361eab10 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:46.545651 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-bc8fa6ef-64fe-4183-95a4-e718361eab10 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:46.548172 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-bc8fa6ef-64fe-4183-95a4-e718361eab10 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:46.548833 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-bc8fa6ef-64fe-4183-95a4-e718361eab10 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1738 microversion: 2.20 time: 0.190569 Aug 31 13:09:46.549870 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 411/838] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:09:46 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1738 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:09:47.572615 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-81bf0d4a-9762-45c9-9695-55ba2f269087 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:47.573272 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-81bf0d4a-9762-45c9-9695-55ba2f269087 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:47.580004 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-81bf0d4a-9762-45c9-9695-55ba2f269087 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:47.580482 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-81bf0d4a-9762-45c9-9695-55ba2f269087 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:47.580911 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-81bf0d4a-9762-45c9-9695-55ba2f269087 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:47.581814 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-81bf0d4a-9762-45c9-9695-55ba2f269087 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:47.582275 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-81bf0d4a-9762-45c9-9695-55ba2f269087 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:47.582685 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-81bf0d4a-9762-45c9-9695-55ba2f269087 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:47.715892 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-81bf0d4a-9762-45c9-9695-55ba2f269087 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:47.724437 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-81bf0d4a-9762-45c9-9695-55ba2f269087 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:47.725978 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-81bf0d4a-9762-45c9-9695-55ba2f269087 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:47.727235 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-81bf0d4a-9762-45c9-9695-55ba2f269087 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1738 microversion: 2.20 time: 0.158642 Aug 31 13:09:47.727917 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 428/839] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:09:47 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:09:48.750878 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-7407df79-6bd3-4f94-a9ea-f1837d807b93 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:48.751438 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-7407df79-6bd3-4f94-a9ea-f1837d807b93 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:48.758084 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7407df79-6bd3-4f94-a9ea-f1837d807b93 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:48.758551 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7407df79-6bd3-4f94-a9ea-f1837d807b93 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:48.758985 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7407df79-6bd3-4f94-a9ea-f1837d807b93 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:48.759673 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7407df79-6bd3-4f94-a9ea-f1837d807b93 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:48.760181 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7407df79-6bd3-4f94-a9ea-f1837d807b93 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:48.760605 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7407df79-6bd3-4f94-a9ea-f1837d807b93 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:48.894911 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-7407df79-6bd3-4f94-a9ea-f1837d807b93 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:48.903464 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-7407df79-6bd3-4f94-a9ea-f1837d807b93 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:48.905267 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-7407df79-6bd3-4f94-a9ea-f1837d807b93 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:48.906432 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-7407df79-6bd3-4f94-a9ea-f1837d807b93 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1720 microversion: 2.20 time: 0.159706 Aug 31 13:09:48.907292 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 412/840] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:09:48 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:09:49.929928 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-7425931d-2d9f-4365-ae95-dfc605ec399a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:49.930511 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-7425931d-2d9f-4365-ae95-dfc605ec399a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:49.933179 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 13:09:49.933355 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Wed Aug 31 13:09:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d (ip 10.222.0.58) !!! Aug 31 13:09:49.940049 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7425931d-2d9f-4365-ae95-dfc605ec399a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:49.940402 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7425931d-2d9f-4365-ae95-dfc605ec399a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:49.941103 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7425931d-2d9f-4365-ae95-dfc605ec399a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:49.941806 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7425931d-2d9f-4365-ae95-dfc605ec399a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:49.942253 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7425931d-2d9f-4365-ae95-dfc605ec399a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:49.943105 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7425931d-2d9f-4365-ae95-dfc605ec399a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:50.341061 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-7425931d-2d9f-4365-ae95-dfc605ec399a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:50.350829 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-7425931d-2d9f-4365-ae95-dfc605ec399a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:50.352416 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-7425931d-2d9f-4365-ae95-dfc605ec399a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:50.353875 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-7425931d-2d9f-4365-ae95-dfc605ec399a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1720 microversion: 2.20 time: 0.427889 Aug 31 13:09:50.354949 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 429/841] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:09:49 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1720 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:09:51.382183 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-6ac547ec-9871-44f8-a8b1-6e232c4d52e8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:51.383213 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-6ac547ec-9871-44f8-a8b1-6e232c4d52e8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:51.391888 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6ac547ec-9871-44f8-a8b1-6e232c4d52e8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:51.392119 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6ac547ec-9871-44f8-a8b1-6e232c4d52e8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:51.392490 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6ac547ec-9871-44f8-a8b1-6e232c4d52e8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:51.393234 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6ac547ec-9871-44f8-a8b1-6e232c4d52e8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:51.393682 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6ac547ec-9871-44f8-a8b1-6e232c4d52e8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:51.394104 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6ac547ec-9871-44f8-a8b1-6e232c4d52e8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:51.491733 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-1d4cc205-5bf4-4e2e-bb43-55c90e928ef1 req-bacd2412-de64-4113-8cf2-702fd0c84eef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21c9e3cb-e5b1-428d-8405-ec33632c5f3d", "name": "network-vif-unplugged", "status": "completed", "tag": "b32c3e63-7e7a-4bf8-bf81-80a7acf17f63"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:09:51.505151 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-1d4cc205-5bf4-4e2e-bb43-55c90e928ef1 req-bacd2412-de64-4113-8cf2-702fd0c84eef service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:51.505949 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-1d4cc205-5bf4-4e2e-bb43-55c90e928ef1 req-bacd2412-de64-4113-8cf2-702fd0c84eef service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:51.506608 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-1d4cc205-5bf4-4e2e-bb43-55c90e928ef1 req-bacd2412-de64-4113-8cf2-702fd0c84eef service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:51.520047 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.compute.server_external_events [req-1d4cc205-5bf4-4e2e-bb43-55c90e928ef1 req-bacd2412-de64-4113-8cf2-702fd0c84eef service nova] Unable to find a host for instance 21c9e3cb-e5b1-428d-8405-ec33632c5f3d. Dropping event network-vif-unplugged {{(pid=120704) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 31 13:09:51.521211 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-1d4cc205-5bf4-4e2e-bb43-55c90e928ef1 req-bacd2412-de64-4113-8cf2-702fd0c84eef service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034869 Aug 31 13:09:51.522017 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 430/842] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 31 13:09:51.539573 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-6ac547ec-9871-44f8-a8b1-6e232c4d52e8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:51.549323 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-6ac547ec-9871-44f8-a8b1-6e232c4d52e8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:51.550771 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-6ac547ec-9871-44f8-a8b1-6e232c4d52e8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:51.551987 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-6ac547ec-9871-44f8-a8b1-6e232c4d52e8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1663 microversion: 2.20 time: 0.176731 Aug 31 13:09:51.552819 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 413/843] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:09:51 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1663 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:09:51.574444 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-0f37900d-79e0-4c1c-b9a1-f5bfe39af01e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b34f3be1-56ce-4f99-b5fe-9a5747f70833"}} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:09:51.576868 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-0f37900d-79e0-4c1c-b9a1-f5bfe39af01e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:51.583101 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0f37900d-79e0-4c1c-b9a1-f5bfe39af01e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:51.583579 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0f37900d-79e0-4c1c-b9a1-f5bfe39af01e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:51.584040 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0f37900d-79e0-4c1c-b9a1-f5bfe39af01e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:51.584730 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0f37900d-79e0-4c1c-b9a1-f5bfe39af01e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:51.585178 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0f37900d-79e0-4c1c-b9a1-f5bfe39af01e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:51.585595 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0f37900d-79e0-4c1c-b9a1-f5bfe39af01e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:51.876534 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-0f37900d-79e0-4c1c-b9a1-f5bfe39af01e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "POST /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.306198 Aug 31 13:09:51.877095 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 431/844] 10.222.0.58 () {62 vars in 1364 bytes} [Wed Aug 31 13:09:51 2022] POST /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d/os-volume_attachments => generated 188 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 13:09:52.006183 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-65e5c097-3ded-400a-8478-bdff4f4240e6 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:09:52.006771 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-65e5c097-3ded-400a-8478-bdff4f4240e6 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:52.012767 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-65e5c097-3ded-400a-8478-bdff4f4240e6 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:52.013244 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-65e5c097-3ded-400a-8478-bdff4f4240e6 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:52.013675 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-65e5c097-3ded-400a-8478-bdff4f4240e6 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:52.014354 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-65e5c097-3ded-400a-8478-bdff4f4240e6 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:52.014799 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-65e5c097-3ded-400a-8478-bdff4f4240e6 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:52.015222 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-65e5c097-3ded-400a-8478-bdff4f4240e6 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:52.044563 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-65e5c097-3ded-400a-8478-bdff4f4240e6 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120705) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 13:09:52.115496 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-65e5c097-3ded-400a-8478-bdff4f4240e6 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "POST /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d/action" status: 202 len: 0 microversion: 2.20 time: 0.113198 Aug 31 13:09:52.116459 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 414/845] 10.222.0.58 () {62 vars in 1319 bytes} [Wed Aug 31 13:09:52 2022] POST /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:09:52.124221 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-f08c4aad-0802-480f-a43a-a882eaaad9d1 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:52.125054 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-f08c4aad-0802-480f-a43a-a882eaaad9d1 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:52.133572 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f08c4aad-0802-480f-a43a-a882eaaad9d1 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:52.133572 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f08c4aad-0802-480f-a43a-a882eaaad9d1 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:52.133572 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f08c4aad-0802-480f-a43a-a882eaaad9d1 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:52.134814 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f08c4aad-0802-480f-a43a-a882eaaad9d1 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:52.134814 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f08c4aad-0802-480f-a43a-a882eaaad9d1 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:52.134814 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f08c4aad-0802-480f-a43a-a882eaaad9d1 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:52.276781 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-f08c4aad-0802-480f-a43a-a882eaaad9d1 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:52.285968 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-f08c4aad-0802-480f-a43a-a882eaaad9d1 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:52.287420 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-f08c4aad-0802-480f-a43a-a882eaaad9d1 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:52.288641 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-f08c4aad-0802-480f-a43a-a882eaaad9d1 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1749 microversion: 2.20 time: 0.168315 Aug 31 13:09:52.289221 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 432/846] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:09:52 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1749 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:09:53.311575 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3f4d6f56-41f4-483a-abee-6194788cf8b0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:53.312503 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-3f4d6f56-41f4-483a-abee-6194788cf8b0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:53.318721 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3f4d6f56-41f4-483a-abee-6194788cf8b0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:53.319295 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3f4d6f56-41f4-483a-abee-6194788cf8b0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:53.319768 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3f4d6f56-41f4-483a-abee-6194788cf8b0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:53.320724 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3f4d6f56-41f4-483a-abee-6194788cf8b0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:53.321238 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3f4d6f56-41f4-483a-abee-6194788cf8b0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:53.321762 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3f4d6f56-41f4-483a-abee-6194788cf8b0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:53.461124 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-3f4d6f56-41f4-483a-abee-6194788cf8b0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:53.477475 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-3f4d6f56-41f4-483a-abee-6194788cf8b0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:53.479179 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-3f4d6f56-41f4-483a-abee-6194788cf8b0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:53.480438 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-3f4d6f56-41f4-483a-abee-6194788cf8b0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1749 microversion: 2.20 time: 0.173343 Aug 31 13:09:53.481025 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 415/847] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:09:53 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1749 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:09:54.505780 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-59cc747f-360d-4533-b30b-c265488f3495 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:54.506636 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-59cc747f-360d-4533-b30b-c265488f3495 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:54.515402 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-59cc747f-360d-4533-b30b-c265488f3495 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:54.515887 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-59cc747f-360d-4533-b30b-c265488f3495 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:54.516331 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-59cc747f-360d-4533-b30b-c265488f3495 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:54.517049 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-59cc747f-360d-4533-b30b-c265488f3495 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:54.517933 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-59cc747f-360d-4533-b30b-c265488f3495 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:54.518095 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-59cc747f-360d-4533-b30b-c265488f3495 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:54.521818 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:09:54.728460 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-59cc747f-360d-4533-b30b-c265488f3495 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:54.737984 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-59cc747f-360d-4533-b30b-c265488f3495 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:54.739445 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-59cc747f-360d-4533-b30b-c265488f3495 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:54.741123 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-59cc747f-360d-4533-b30b-c265488f3495 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1807 microversion: 2.20 time: 0.240500 Aug 31 13:09:54.741762 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 433/848] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:09:54 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1807 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:09:55.765563 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-96be49ab-1852-4c6e-b12e-799754aec612 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:55.766196 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-96be49ab-1852-4c6e-b12e-799754aec612 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:55.770245 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:09:55.774598 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-96be49ab-1852-4c6e-b12e-799754aec612 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:55.775247 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-96be49ab-1852-4c6e-b12e-799754aec612 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:55.775736 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-96be49ab-1852-4c6e-b12e-799754aec612 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:55.776657 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-96be49ab-1852-4c6e-b12e-799754aec612 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:55.777714 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-96be49ab-1852-4c6e-b12e-799754aec612 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:55.778532 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-96be49ab-1852-4c6e-b12e-799754aec612 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:55.782386 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:09:55.925683 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-96be49ab-1852-4c6e-b12e-799754aec612 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:55.934892 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-96be49ab-1852-4c6e-b12e-799754aec612 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:55.936733 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-96be49ab-1852-4c6e-b12e-799754aec612 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:55.938780 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-96be49ab-1852-4c6e-b12e-799754aec612 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1807 microversion: 2.20 time: 0.177186 Aug 31 13:09:55.939849 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 416/849] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:09:55 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:09:56.963380 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-9446ffc5-e8f0-419f-a29a-ce32d36179be tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:56.964434 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-9446ffc5-e8f0-419f-a29a-ce32d36179be tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:56.967099 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_api:SELECT=34 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:09:56.973634 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9446ffc5-e8f0-419f-a29a-ce32d36179be tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:56.974282 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9446ffc5-e8f0-419f-a29a-ce32d36179be tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:56.974721 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9446ffc5-e8f0-419f-a29a-ce32d36179be tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:56.975426 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9446ffc5-e8f0-419f-a29a-ce32d36179be tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:56.975896 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9446ffc5-e8f0-419f-a29a-ce32d36179be tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:56.976350 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9446ffc5-e8f0-419f-a29a-ce32d36179be tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:57.144311 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-9446ffc5-e8f0-419f-a29a-ce32d36179be tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:57.153818 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-9446ffc5-e8f0-419f-a29a-ce32d36179be tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:57.158612 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-9446ffc5-e8f0-419f-a29a-ce32d36179be tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:57.160169 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-9446ffc5-e8f0-419f-a29a-ce32d36179be tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1807 microversion: 2.20 time: 0.201450 Aug 31 13:09:57.160901 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 434/850] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:09:56 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1807 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:09:57.242084 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-634bce46-82f1-45a6-94ba-f95e10e64f3b tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:57.242799 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-634bce46-82f1-45a6-94ba-f95e10e64f3b tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:57.249730 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-634bce46-82f1-45a6-94ba-f95e10e64f3b tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:57.250502 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-634bce46-82f1-45a6-94ba-f95e10e64f3b tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:57.251074 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-634bce46-82f1-45a6-94ba-f95e10e64f3b tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:57.251911 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-634bce46-82f1-45a6-94ba-f95e10e64f3b tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:57.252364 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-634bce46-82f1-45a6-94ba-f95e10e64f3b tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:57.252827 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-634bce46-82f1-45a6-94ba-f95e10e64f3b tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:57.278384 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-634bce46-82f1-45a6-94ba-f95e10e64f3b tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad/ips" status: 200 len: 147 microversion: 2.1 time: 0.040140 Aug 31 13:09:57.279541 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 417/851] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 31 13:09:57 2022] GET /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad/ips => generated 147 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:09:58.182527 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-88506722-d3fb-4307-8b18-73fe96dda0c4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:58.183135 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-88506722-d3fb-4307-8b18-73fe96dda0c4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:58.190192 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-88506722-d3fb-4307-8b18-73fe96dda0c4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:58.190729 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-88506722-d3fb-4307-8b18-73fe96dda0c4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:58.191116 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-88506722-d3fb-4307-8b18-73fe96dda0c4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:58.191828 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-88506722-d3fb-4307-8b18-73fe96dda0c4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:58.192285 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-88506722-d3fb-4307-8b18-73fe96dda0c4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:58.192800 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-88506722-d3fb-4307-8b18-73fe96dda0c4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:58.346142 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-88506722-d3fb-4307-8b18-73fe96dda0c4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:58.356117 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-88506722-d3fb-4307-8b18-73fe96dda0c4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:58.357554 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-88506722-d3fb-4307-8b18-73fe96dda0c4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:58.369335 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-88506722-d3fb-4307-8b18-73fe96dda0c4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1807 microversion: 2.20 time: 0.190648 Aug 31 13:09:58.370151 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 435/852] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:09:58 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1807 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:09:58.702030 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-252c61ae-4f8c-4e1c-b258-4a1e5ca2e8c2 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ebd3da60-4e83-4424-bdc4-1dd56c99df4b"}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:09:58.704507 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-252c61ae-4f8c-4e1c-b258-4a1e5ca2e8c2 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:58.715668 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-252c61ae-4f8c-4e1c-b258-4a1e5ca2e8c2 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:58.716179 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-252c61ae-4f8c-4e1c-b258-4a1e5ca2e8c2 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:58.716610 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-252c61ae-4f8c-4e1c-b258-4a1e5ca2e8c2 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:58.717305 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-252c61ae-4f8c-4e1c-b258-4a1e5ca2e8c2 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:58.717786 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-252c61ae-4f8c-4e1c-b258-4a1e5ca2e8c2 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:58.718210 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-252c61ae-4f8c-4e1c-b258-4a1e5ca2e8c2 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:59.392513 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-49d8793b-23a3-430b-9a5e-4bd684844515 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:09:59.393182 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-49d8793b-23a3-430b-9a5e-4bd684844515 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:09:59.400248 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-49d8793b-23a3-430b-9a5e-4bd684844515 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:59.400732 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-49d8793b-23a3-430b-9a5e-4bd684844515 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:59.401216 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-49d8793b-23a3-430b-9a5e-4bd684844515 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:59.401929 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-49d8793b-23a3-430b-9a5e-4bd684844515 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:09:59.402376 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-49d8793b-23a3-430b-9a5e-4bd684844515 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:09:59.402811 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-49d8793b-23a3-430b-9a5e-4bd684844515 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:09:59.544762 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-49d8793b-23a3-430b-9a5e-4bd684844515 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:59.554111 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-49d8793b-23a3-430b-9a5e-4bd684844515 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:59.555557 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-49d8793b-23a3-430b-9a5e-4bd684844515 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:09:59.556817 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-49d8793b-23a3-430b-9a5e-4bd684844515 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1807 microversion: 2.20 time: 0.168677 Aug 31 13:09:59.557967 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 436/853] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:09:59 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:10:00.580714 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-3a633c0c-f468-488c-856c-e4c1c64ee3d6 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:10:00.581421 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-3a633c0c-f468-488c-856c-e4c1c64ee3d6 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:10:00.588154 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3a633c0c-f468-488c-856c-e4c1c64ee3d6 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:00.588761 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3a633c0c-f468-488c-856c-e4c1c64ee3d6 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:00.589194 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3a633c0c-f468-488c-856c-e4c1c64ee3d6 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:00.589927 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3a633c0c-f468-488c-856c-e4c1c64ee3d6 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:00.590441 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3a633c0c-f468-488c-856c-e4c1c64ee3d6 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:00.590859 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3a633c0c-f468-488c-856c-e4c1c64ee3d6 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:00.913413 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-3a633c0c-f468-488c-856c-e4c1c64ee3d6 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:00.929126 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-3a633c0c-f468-488c-856c-e4c1c64ee3d6 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:00.930629 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-3a633c0c-f468-488c-856c-e4c1c64ee3d6 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:00.931897 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-3a633c0c-f468-488c-856c-e4c1c64ee3d6 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1807 microversion: 2.20 time: 0.355532 Aug 31 13:10:00.932885 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 437/854] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:10:00 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1807 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:10:01.961781 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-4e9f6803-2fd5-49d2-95c1-c590fddef4f4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:10:01.963670 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-4e9f6803-2fd5-49d2-95c1-c590fddef4f4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:10:01.971952 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4e9f6803-2fd5-49d2-95c1-c590fddef4f4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:01.973400 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4e9f6803-2fd5-49d2-95c1-c590fddef4f4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:01.973882 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4e9f6803-2fd5-49d2-95c1-c590fddef4f4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:01.974624 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4e9f6803-2fd5-49d2-95c1-c590fddef4f4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:01.975245 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4e9f6803-2fd5-49d2-95c1-c590fddef4f4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:01.975832 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4e9f6803-2fd5-49d2-95c1-c590fddef4f4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:02.128799 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-4e9f6803-2fd5-49d2-95c1-c590fddef4f4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:02.138071 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-4e9f6803-2fd5-49d2-95c1-c590fddef4f4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:02.139517 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-4e9f6803-2fd5-49d2-95c1-c590fddef4f4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:02.140733 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-4e9f6803-2fd5-49d2-95c1-c590fddef4f4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1807 microversion: 2.20 time: 0.187396 Aug 31 13:10:02.141296 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 438/855] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:10:01 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:10:03.164913 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-24ff6715-d265-4293-bd0b-64fb5ed98c0d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:10:03.166048 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-24ff6715-d265-4293-bd0b-64fb5ed98c0d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:10:03.171988 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-24ff6715-d265-4293-bd0b-64fb5ed98c0d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:03.172475 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-24ff6715-d265-4293-bd0b-64fb5ed98c0d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:03.173068 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-24ff6715-d265-4293-bd0b-64fb5ed98c0d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:03.173665 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-24ff6715-d265-4293-bd0b-64fb5ed98c0d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:03.174251 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-24ff6715-d265-4293-bd0b-64fb5ed98c0d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:03.174671 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-24ff6715-d265-4293-bd0b-64fb5ed98c0d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:03.311011 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-24ff6715-d265-4293-bd0b-64fb5ed98c0d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:03.321517 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-24ff6715-d265-4293-bd0b-64fb5ed98c0d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:03.323681 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-24ff6715-d265-4293-bd0b-64fb5ed98c0d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:03.324885 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-24ff6715-d265-4293-bd0b-64fb5ed98c0d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1807 microversion: 2.20 time: 0.164307 Aug 31 13:10:03.325496 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 439/856] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:10:03 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:10:04.352047 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-ac8c65de-5ca1-45a6-9b90-5124aefe251c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:10:04.352823 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-ac8c65de-5ca1-45a6-9b90-5124aefe251c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:10:04.359207 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ac8c65de-5ca1-45a6-9b90-5124aefe251c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:04.359658 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ac8c65de-5ca1-45a6-9b90-5124aefe251c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:04.360127 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ac8c65de-5ca1-45a6-9b90-5124aefe251c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:04.360813 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ac8c65de-5ca1-45a6-9b90-5124aefe251c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:04.361363 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ac8c65de-5ca1-45a6-9b90-5124aefe251c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:04.361791 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ac8c65de-5ca1-45a6-9b90-5124aefe251c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:04.510980 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-ac8c65de-5ca1-45a6-9b90-5124aefe251c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:04.520539 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-ac8c65de-5ca1-45a6-9b90-5124aefe251c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:04.522056 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-ac8c65de-5ca1-45a6-9b90-5124aefe251c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:04.523331 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-ac8c65de-5ca1-45a6-9b90-5124aefe251c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1807 microversion: 2.20 time: 0.175353 Aug 31 13:10:04.524293 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 440/857] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:10:04 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:10:05.547018 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-3ff17b21-f2f7-43e9-a897-7151c41fd899 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:10:05.548008 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-3ff17b21-f2f7-43e9-a897-7151c41fd899 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:10:05.555060 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3ff17b21-f2f7-43e9-a897-7151c41fd899 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:05.555534 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3ff17b21-f2f7-43e9-a897-7151c41fd899 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:05.555997 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3ff17b21-f2f7-43e9-a897-7151c41fd899 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:05.556698 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3ff17b21-f2f7-43e9-a897-7151c41fd899 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:05.557249 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3ff17b21-f2f7-43e9-a897-7151c41fd899 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:05.557684 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3ff17b21-f2f7-43e9-a897-7151c41fd899 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:05.752273 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-3ff17b21-f2f7-43e9-a897-7151c41fd899 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:05.761724 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-3ff17b21-f2f7-43e9-a897-7151c41fd899 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:05.763179 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-3ff17b21-f2f7-43e9-a897-7151c41fd899 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:05.764405 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-3ff17b21-f2f7-43e9-a897-7151c41fd899 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1807 microversion: 2.20 time: 0.221712 Aug 31 13:10:05.764972 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 441/858] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:10:05 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1807 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:10:06.787384 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-4ba7f2f8-a1fe-432d-8786-72c1e7c10253 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:10:06.787997 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-4ba7f2f8-a1fe-432d-8786-72c1e7c10253 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:10:06.795365 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4ba7f2f8-a1fe-432d-8786-72c1e7c10253 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:06.795891 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4ba7f2f8-a1fe-432d-8786-72c1e7c10253 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:06.796382 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4ba7f2f8-a1fe-432d-8786-72c1e7c10253 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:06.797134 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4ba7f2f8-a1fe-432d-8786-72c1e7c10253 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:06.797630 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4ba7f2f8-a1fe-432d-8786-72c1e7c10253 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:06.798183 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4ba7f2f8-a1fe-432d-8786-72c1e7c10253 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:06.932209 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-4ba7f2f8-a1fe-432d-8786-72c1e7c10253 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:06.944242 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-4ba7f2f8-a1fe-432d-8786-72c1e7c10253 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:06.946071 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-4ba7f2f8-a1fe-432d-8786-72c1e7c10253 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:06.947698 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-4ba7f2f8-a1fe-432d-8786-72c1e7c10253 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1807 microversion: 2.20 time: 0.164349 Aug 31 13:10:06.948434 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 442/859] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:10:06 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:10:07.970686 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-f6a1051c-ef08-4aa7-82ab-01035ffa229e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:10:07.971312 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-f6a1051c-ef08-4aa7-82ab-01035ffa229e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:10:07.978443 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f6a1051c-ef08-4aa7-82ab-01035ffa229e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:07.978921 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f6a1051c-ef08-4aa7-82ab-01035ffa229e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:07.979355 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f6a1051c-ef08-4aa7-82ab-01035ffa229e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:07.980126 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f6a1051c-ef08-4aa7-82ab-01035ffa229e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:07.980758 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f6a1051c-ef08-4aa7-82ab-01035ffa229e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:07.981192 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f6a1051c-ef08-4aa7-82ab-01035ffa229e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:08.117214 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-f6a1051c-ef08-4aa7-82ab-01035ffa229e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:08.126025 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-f6a1051c-ef08-4aa7-82ab-01035ffa229e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:08.127760 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-f6a1051c-ef08-4aa7-82ab-01035ffa229e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:08.129106 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-f6a1051c-ef08-4aa7-82ab-01035ffa229e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1807 microversion: 2.20 time: 0.162289 Aug 31 13:10:08.129710 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 443/860] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:10:07 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:10:08.714352 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=5 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:10:08.828061 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=15 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:10:09.156185 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-30c4bb60-8117-45e9-8d4a-fe5ab06dc2eb tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:10:09.157037 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-30c4bb60-8117-45e9-8d4a-fe5ab06dc2eb tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:10:09.167165 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-30c4bb60-8117-45e9-8d4a-fe5ab06dc2eb tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:09.167952 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-30c4bb60-8117-45e9-8d4a-fe5ab06dc2eb tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:09.168389 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-30c4bb60-8117-45e9-8d4a-fe5ab06dc2eb tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:09.169076 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-30c4bb60-8117-45e9-8d4a-fe5ab06dc2eb tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:09.169517 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-30c4bb60-8117-45e9-8d4a-fe5ab06dc2eb tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:09.169942 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-30c4bb60-8117-45e9-8d4a-fe5ab06dc2eb tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:09.301145 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-30c4bb60-8117-45e9-8d4a-fe5ab06dc2eb tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:09.310076 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-30c4bb60-8117-45e9-8d4a-fe5ab06dc2eb tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:09.311396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-30c4bb60-8117-45e9-8d4a-fe5ab06dc2eb tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:09.312666 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-30c4bb60-8117-45e9-8d4a-fe5ab06dc2eb tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1807 microversion: 2.20 time: 0.162712 Aug 31 13:10:09.313244 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 444/861] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:10:09 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:10:09.948112 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-252c61ae-4f8c-4e1c-b258-4a1e5ca2e8c2 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "POST /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 11.249949 Aug 31 13:10:09.948770 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 418/862] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 31 13:09:58 2022] POST /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad/os-volume_attachments => generated 194 bytes in 11251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:10:10.340198 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-4133f207-0e09-41bc-8dd0-d7c1a32dc64a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:10:10.340844 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-4133f207-0e09-41bc-8dd0-d7c1a32dc64a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:10:10.348447 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4133f207-0e09-41bc-8dd0-d7c1a32dc64a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:10.348980 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4133f207-0e09-41bc-8dd0-d7c1a32dc64a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:10.349458 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4133f207-0e09-41bc-8dd0-d7c1a32dc64a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:10.350232 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4133f207-0e09-41bc-8dd0-d7c1a32dc64a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:10.350732 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4133f207-0e09-41bc-8dd0-d7c1a32dc64a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:10.351212 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4133f207-0e09-41bc-8dd0-d7c1a32dc64a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:10.482688 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-4133f207-0e09-41bc-8dd0-d7c1a32dc64a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:10.496019 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-4133f207-0e09-41bc-8dd0-d7c1a32dc64a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:10.497446 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-4133f207-0e09-41bc-8dd0-d7c1a32dc64a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:10.498608 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-4133f207-0e09-41bc-8dd0-d7c1a32dc64a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1807 microversion: 2.20 time: 0.165372 Aug 31 13:10:10.499159 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 445/863] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:10:10 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:10:11.528781 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-a8510659-93e9-49be-b4b4-f5c07a9b394f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:10:11.530281 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-a8510659-93e9-49be-b4b4-f5c07a9b394f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:10:11.541425 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a8510659-93e9-49be-b4b4-f5c07a9b394f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:11.542207 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a8510659-93e9-49be-b4b4-f5c07a9b394f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:11.543346 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a8510659-93e9-49be-b4b4-f5c07a9b394f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:11.544120 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a8510659-93e9-49be-b4b4-f5c07a9b394f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:11.544567 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a8510659-93e9-49be-b4b4-f5c07a9b394f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:11.545001 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a8510659-93e9-49be-b4b4-f5c07a9b394f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:11.683125 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-a8510659-93e9-49be-b4b4-f5c07a9b394f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:11.692037 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-a8510659-93e9-49be-b4b4-f5c07a9b394f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:11.693459 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-a8510659-93e9-49be-b4b4-f5c07a9b394f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:11.694810 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-a8510659-93e9-49be-b4b4-f5c07a9b394f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1807 microversion: 2.20 time: 0.174747 Aug 31 13:10:11.695383 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 419/864] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:10:11 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:10:12.718867 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-5ba41c9a-bf4e-4a78-b81d-27171a8aad97 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:10:12.719492 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-5ba41c9a-bf4e-4a78-b81d-27171a8aad97 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:10:12.726682 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5ba41c9a-bf4e-4a78-b81d-27171a8aad97 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:12.727098 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5ba41c9a-bf4e-4a78-b81d-27171a8aad97 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:12.727529 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5ba41c9a-bf4e-4a78-b81d-27171a8aad97 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:12.728273 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5ba41c9a-bf4e-4a78-b81d-27171a8aad97 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:12.728730 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5ba41c9a-bf4e-4a78-b81d-27171a8aad97 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:12.729151 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5ba41c9a-bf4e-4a78-b81d-27171a8aad97 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:12.861210 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-5ba41c9a-bf4e-4a78-b81d-27171a8aad97 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:12.870114 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-5ba41c9a-bf4e-4a78-b81d-27171a8aad97 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:12.871577 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-5ba41c9a-bf4e-4a78-b81d-27171a8aad97 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:12.872936 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-5ba41c9a-bf4e-4a78-b81d-27171a8aad97 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1807 microversion: 2.20 time: 0.158086 Aug 31 13:10:12.873562 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 446/865] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:10:12 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:10:13.896988 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-2784e6c7-fc06-4a3f-ba05-31b2198ef7ed tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:10:13.897536 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-2784e6c7-fc06-4a3f-ba05-31b2198ef7ed tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:10:13.904333 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2784e6c7-fc06-4a3f-ba05-31b2198ef7ed tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:13.905149 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2784e6c7-fc06-4a3f-ba05-31b2198ef7ed tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:13.905580 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2784e6c7-fc06-4a3f-ba05-31b2198ef7ed tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:13.906284 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2784e6c7-fc06-4a3f-ba05-31b2198ef7ed tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:13.906737 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2784e6c7-fc06-4a3f-ba05-31b2198ef7ed tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:13.907162 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2784e6c7-fc06-4a3f-ba05-31b2198ef7ed tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:14.051877 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-2784e6c7-fc06-4a3f-ba05-31b2198ef7ed tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:14.061210 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-2784e6c7-fc06-4a3f-ba05-31b2198ef7ed tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:14.062702 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-2784e6c7-fc06-4a3f-ba05-31b2198ef7ed tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:14.063910 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-2784e6c7-fc06-4a3f-ba05-31b2198ef7ed tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1807 microversion: 2.20 time: 0.171183 Aug 31 13:10:14.064490 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 420/866] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:10:13 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:10:15.092262 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-542d6993-4950-46c7-8cd7-0813989ca21b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:10:15.092825 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-542d6993-4950-46c7-8cd7-0813989ca21b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:10:15.099238 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-542d6993-4950-46c7-8cd7-0813989ca21b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:15.099710 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-542d6993-4950-46c7-8cd7-0813989ca21b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:15.100164 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-542d6993-4950-46c7-8cd7-0813989ca21b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:15.100961 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-542d6993-4950-46c7-8cd7-0813989ca21b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:15.101403 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-542d6993-4950-46c7-8cd7-0813989ca21b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:15.101821 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-542d6993-4950-46c7-8cd7-0813989ca21b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:15.255408 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-542d6993-4950-46c7-8cd7-0813989ca21b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:15.266884 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-542d6993-4950-46c7-8cd7-0813989ca21b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:15.268362 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-542d6993-4950-46c7-8cd7-0813989ca21b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:15.269540 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-542d6993-4950-46c7-8cd7-0813989ca21b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1807 microversion: 2.20 time: 0.182273 Aug 31 13:10:15.270105 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 447/867] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:10:15 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:10:16.305204 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-c6fce7db-0386-4091-bd9b-7a39d0bfeff4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:10:16.306156 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-c6fce7db-0386-4091-bd9b-7a39d0bfeff4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:10:16.314461 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c6fce7db-0386-4091-bd9b-7a39d0bfeff4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:16.315006 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c6fce7db-0386-4091-bd9b-7a39d0bfeff4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:16.315434 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c6fce7db-0386-4091-bd9b-7a39d0bfeff4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:16.316150 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c6fce7db-0386-4091-bd9b-7a39d0bfeff4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:16.316592 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c6fce7db-0386-4091-bd9b-7a39d0bfeff4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:16.317014 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c6fce7db-0386-4091-bd9b-7a39d0bfeff4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:16.452112 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-c6fce7db-0386-4091-bd9b-7a39d0bfeff4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:16.461075 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-c6fce7db-0386-4091-bd9b-7a39d0bfeff4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:16.463647 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-c6fce7db-0386-4091-bd9b-7a39d0bfeff4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:16.465571 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-c6fce7db-0386-4091-bd9b-7a39d0bfeff4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1807 microversion: 2.20 time: 0.167270 Aug 31 13:10:16.466651 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 421/868] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:10:16 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:10:17.493117 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-51a4c382-8b3d-4f27-994b-6e60c054fde9 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:10:17.494163 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-51a4c382-8b3d-4f27-994b-6e60c054fde9 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:10:17.505317 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-51a4c382-8b3d-4f27-994b-6e60c054fde9 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:17.506137 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-51a4c382-8b3d-4f27-994b-6e60c054fde9 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:17.506847 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-51a4c382-8b3d-4f27-994b-6e60c054fde9 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:17.508061 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-51a4c382-8b3d-4f27-994b-6e60c054fde9 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:17.508814 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-51a4c382-8b3d-4f27-994b-6e60c054fde9 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:17.509520 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-51a4c382-8b3d-4f27-994b-6e60c054fde9 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:17.642822 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-51a4c382-8b3d-4f27-994b-6e60c054fde9 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:17.652391 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-51a4c382-8b3d-4f27-994b-6e60c054fde9 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:17.653849 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-51a4c382-8b3d-4f27-994b-6e60c054fde9 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:17.655392 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-51a4c382-8b3d-4f27-994b-6e60c054fde9 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1807 microversion: 2.20 time: 0.168845 Aug 31 13:10:17.655997 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 448/869] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:10:17 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:10:18.678645 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-1885f1af-3cac-44f8-ae3d-d0707c2275c7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:10:18.679244 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-1885f1af-3cac-44f8-ae3d-d0707c2275c7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:10:18.686159 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1885f1af-3cac-44f8-ae3d-d0707c2275c7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:18.686846 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1885f1af-3cac-44f8-ae3d-d0707c2275c7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:18.687273 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1885f1af-3cac-44f8-ae3d-d0707c2275c7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:18.688023 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1885f1af-3cac-44f8-ae3d-d0707c2275c7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:18.688466 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1885f1af-3cac-44f8-ae3d-d0707c2275c7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:18.688881 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1885f1af-3cac-44f8-ae3d-d0707c2275c7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:18.821974 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-1885f1af-3cac-44f8-ae3d-d0707c2275c7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:18.831061 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-1885f1af-3cac-44f8-ae3d-d0707c2275c7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:18.832526 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-1885f1af-3cac-44f8-ae3d-d0707c2275c7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:18.833698 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-1885f1af-3cac-44f8-ae3d-d0707c2275c7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1807 microversion: 2.20 time: 0.159027 Aug 31 13:10:18.834261 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 422/870] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:10:18 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:10:19.857318 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-4b40445c-304e-429a-a609-d7febc6291fe tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:10:19.858041 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-4b40445c-304e-429a-a609-d7febc6291fe tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:10:19.865336 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4b40445c-304e-429a-a609-d7febc6291fe tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:19.865810 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4b40445c-304e-429a-a609-d7febc6291fe tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:19.866265 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4b40445c-304e-429a-a609-d7febc6291fe tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:19.867039 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4b40445c-304e-429a-a609-d7febc6291fe tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:19.867482 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4b40445c-304e-429a-a609-d7febc6291fe tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:19.867944 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4b40445c-304e-429a-a609-d7febc6291fe tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:20.016789 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-4b40445c-304e-429a-a609-d7febc6291fe tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:20.020121 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell1:SELECT=100 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:10:20.030987 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-4b40445c-304e-429a-a609-d7febc6291fe tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:20.032575 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-4b40445c-304e-429a-a609-d7febc6291fe tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:20.033777 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-4b40445c-304e-429a-a609-d7febc6291fe tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1807 microversion: 2.20 time: 0.181468 Aug 31 13:10:20.034348 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 449/871] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:10:19 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:10:21.060634 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-5927cf2a-2a67-4e8b-932d-7fee8a775be0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:10:21.061631 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-5927cf2a-2a67-4e8b-932d-7fee8a775be0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:10:21.073307 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5927cf2a-2a67-4e8b-932d-7fee8a775be0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:21.074256 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5927cf2a-2a67-4e8b-932d-7fee8a775be0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:21.074984 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5927cf2a-2a67-4e8b-932d-7fee8a775be0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:21.076198 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5927cf2a-2a67-4e8b-932d-7fee8a775be0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:21.076959 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5927cf2a-2a67-4e8b-932d-7fee8a775be0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:21.077668 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5927cf2a-2a67-4e8b-932d-7fee8a775be0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:21.224211 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-5927cf2a-2a67-4e8b-932d-7fee8a775be0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:21.234504 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-5927cf2a-2a67-4e8b-932d-7fee8a775be0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:21.236602 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-5927cf2a-2a67-4e8b-932d-7fee8a775be0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:21.237774 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-5927cf2a-2a67-4e8b-932d-7fee8a775be0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1807 microversion: 2.20 time: 0.183971 Aug 31 13:10:21.238527 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 423/872] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:10:21 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:10:21.890253 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-e262e336-c53a-46ab-9490-f37beb6be35e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:10:21.890806 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-e262e336-c53a-46ab-9490-f37beb6be35e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:10:21.897663 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e262e336-c53a-46ab-9490-f37beb6be35e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:21.898144 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e262e336-c53a-46ab-9490-f37beb6be35e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:21.898583 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e262e336-c53a-46ab-9490-f37beb6be35e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:21.899272 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e262e336-c53a-46ab-9490-f37beb6be35e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:21.899719 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e262e336-c53a-46ab-9490-f37beb6be35e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:21.900174 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e262e336-c53a-46ab-9490-f37beb6be35e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:21.984152 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.objects.instance [None req-e262e336-c53a-46ab-9490-f37beb6be35e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lazy-loading 'services' on Instance uuid 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad {{(pid=120704) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 13:10:22.061093 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-e262e336-c53a-46ab-9490-f37beb6be35e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "DELETE /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad/os-volume_attachments/ebd3da60-4e83-4424-bdc4-1dd56c99df4b" status: 202 len: 0 microversion: 2.1 time: 0.174683 Aug 31 13:10:22.061987 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 450/873] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 31 13:10:21 2022] DELETE /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad/os-volume_attachments/ebd3da60-4e83-4424-bdc4-1dd56c99df4b => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:10:22.071252 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-4905c7d8-2847-4390-b588-624a11ece750 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:10:22.074260 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-4905c7d8-2847-4390-b588-624a11ece750 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:10:22.082666 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4905c7d8-2847-4390-b588-624a11ece750 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:22.083553 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4905c7d8-2847-4390-b588-624a11ece750 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:22.084080 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4905c7d8-2847-4390-b588-624a11ece750 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:22.084784 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4905c7d8-2847-4390-b588-624a11ece750 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:22.085232 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4905c7d8-2847-4390-b588-624a11ece750 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:22.085651 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4905c7d8-2847-4390-b588-624a11ece750 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:22.118837 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-4905c7d8-2847-4390-b588-624a11ece750 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052480 Aug 31 13:10:22.119428 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 424/874] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 31 13:10:22 2022] GET /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:10:22.178049 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-959f8906-6ca8-4c5c-ab23-f2731ce5b41c req-b4afc924-de2a-43c2-9e72-58d22997080c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21c9e3cb-e5b1-428d-8405-ec33632c5f3d", "name": "network-vif-plugged", "status": "completed", "tag": "b32c3e63-7e7a-4bf8-bf81-80a7acf17f63"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:10:22.188941 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-959f8906-6ca8-4c5c-ab23-f2731ce5b41c req-b4afc924-de2a-43c2-9e72-58d22997080c service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:22.189418 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-959f8906-6ca8-4c5c-ab23-f2731ce5b41c req-b4afc924-de2a-43c2-9e72-58d22997080c service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:22.189844 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-959f8906-6ca8-4c5c-ab23-f2731ce5b41c req-b4afc924-de2a-43c2-9e72-58d22997080c service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:22.201091 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-959f8906-6ca8-4c5c-ab23-f2731ce5b41c req-b4afc924-de2a-43c2-9e72-58d22997080c service nova] Creating event network-vif-plugged:b32c3e63-7e7a-4bf8-bf81-80a7acf17f63 for instance 21c9e3cb-e5b1-428d-8405-ec33632c5f3d on hv-cinder-85442 Aug 31 13:10:22.205891 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-959f8906-6ca8-4c5c-ab23-f2731ce5b41c req-b4afc924-de2a-43c2-9e72-58d22997080c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032022 Aug 31 13:10:22.206487 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 451/875] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:10:22.260220 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-8e06ec5f-5e1e-4c33-9d48-c127ce379b33 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:10:22.260824 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-8e06ec5f-5e1e-4c33-9d48-c127ce379b33 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:10:22.266938 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8e06ec5f-5e1e-4c33-9d48-c127ce379b33 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:22.267409 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8e06ec5f-5e1e-4c33-9d48-c127ce379b33 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:22.267858 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8e06ec5f-5e1e-4c33-9d48-c127ce379b33 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:22.268541 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8e06ec5f-5e1e-4c33-9d48-c127ce379b33 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:22.268981 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8e06ec5f-5e1e-4c33-9d48-c127ce379b33 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:22.269399 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8e06ec5f-5e1e-4c33-9d48-c127ce379b33 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:22.403669 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-8e06ec5f-5e1e-4c33-9d48-c127ce379b33 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:22.413458 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-8e06ec5f-5e1e-4c33-9d48-c127ce379b33 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:22.414897 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-8e06ec5f-5e1e-4c33-9d48-c127ce379b33 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:22.416101 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-8e06ec5f-5e1e-4c33-9d48-c127ce379b33 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1807 microversion: 2.20 time: 0.159942 Aug 31 13:10:22.416676 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 425/876] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:10:22 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:10:23.135227 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-3de6d7e9-25d6-41ef-952e-71b66be4a913 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:10:23.137525 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-3de6d7e9-25d6-41ef-952e-71b66be4a913 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:10:23.145240 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3de6d7e9-25d6-41ef-952e-71b66be4a913 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:23.145842 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3de6d7e9-25d6-41ef-952e-71b66be4a913 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:23.146440 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3de6d7e9-25d6-41ef-952e-71b66be4a913 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:23.147500 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3de6d7e9-25d6-41ef-952e-71b66be4a913 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:23.148155 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3de6d7e9-25d6-41ef-952e-71b66be4a913 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:23.148958 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3de6d7e9-25d6-41ef-952e-71b66be4a913 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:23.181657 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-3de6d7e9-25d6-41ef-952e-71b66be4a913 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052350 Aug 31 13:10:23.182225 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 452/877] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 31 13:10:23 2022] GET /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:10:23.443746 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-47b36b01-9f0a-4e8b-b9b1-642aad12d012 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:10:23.445197 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-47b36b01-9f0a-4e8b-b9b1-642aad12d012 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:10:23.455684 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-47b36b01-9f0a-4e8b-b9b1-642aad12d012 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:23.456188 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-47b36b01-9f0a-4e8b-b9b1-642aad12d012 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:23.456618 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-47b36b01-9f0a-4e8b-b9b1-642aad12d012 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:23.457304 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-47b36b01-9f0a-4e8b-b9b1-642aad12d012 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:23.457742 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-47b36b01-9f0a-4e8b-b9b1-642aad12d012 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:23.458158 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-47b36b01-9f0a-4e8b-b9b1-642aad12d012 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:23.600722 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-47b36b01-9f0a-4e8b-b9b1-642aad12d012 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:23.609788 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-47b36b01-9f0a-4e8b-b9b1-642aad12d012 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:23.611295 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-47b36b01-9f0a-4e8b-b9b1-642aad12d012 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:23.612528 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-47b36b01-9f0a-4e8b-b9b1-642aad12d012 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1807 microversion: 2.20 time: 0.175595 Aug 31 13:10:23.613080 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 426/878] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:10:23 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:10:24.194647 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-3c564699-9d5f-4216-8998-675323ce0231 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:10:24.196804 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-3c564699-9d5f-4216-8998-675323ce0231 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:10:24.203567 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3c564699-9d5f-4216-8998-675323ce0231 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:24.204224 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3c564699-9d5f-4216-8998-675323ce0231 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:24.204934 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3c564699-9d5f-4216-8998-675323ce0231 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:24.205614 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3c564699-9d5f-4216-8998-675323ce0231 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:24.206056 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3c564699-9d5f-4216-8998-675323ce0231 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:24.206476 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3c564699-9d5f-4216-8998-675323ce0231 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:24.237066 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-3c564699-9d5f-4216-8998-675323ce0231 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046618 Aug 31 13:10:24.237611 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 453/879] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 31 13:10:24 2022] GET /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 13:10:24.304710 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-2346eed6-a046-439e-93b7-4d5d45064a37 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:10:24.305310 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-2346eed6-a046-439e-93b7-4d5d45064a37 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:10:24.311647 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2346eed6-a046-439e-93b7-4d5d45064a37 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:24.312173 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2346eed6-a046-439e-93b7-4d5d45064a37 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:24.312607 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2346eed6-a046-439e-93b7-4d5d45064a37 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:24.313319 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2346eed6-a046-439e-93b7-4d5d45064a37 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:24.314117 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2346eed6-a046-439e-93b7-4d5d45064a37 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:24.314246 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2346eed6-a046-439e-93b7-4d5d45064a37 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:24.342784 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-2346eed6-a046-439e-93b7-4d5d45064a37 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad] Going to try to terminate instance {{(pid=120705) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 13:10:24.423510 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-2346eed6-a046-439e-93b7-4d5d45064a37 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "DELETE /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad" status: 204 len: 0 microversion: 2.1 time: 0.122834 Aug 31 13:10:24.424516 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 427/880] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 31 13:10:24 2022] DELETE /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:10:24.432795 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-26d5920c-6cb4-4a79-87d2-2a79c0a2ada6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:10:24.433308 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-26d5920c-6cb4-4a79-87d2-2a79c0a2ada6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:10:24.439448 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-26d5920c-6cb4-4a79-87d2-2a79c0a2ada6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:24.440143 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-26d5920c-6cb4-4a79-87d2-2a79c0a2ada6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:24.440572 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-26d5920c-6cb4-4a79-87d2-2a79c0a2ada6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:24.441302 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-26d5920c-6cb4-4a79-87d2-2a79c0a2ada6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:24.441718 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-26d5920c-6cb4-4a79-87d2-2a79c0a2ada6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:24.442137 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-26d5920c-6cb4-4a79-87d2-2a79c0a2ada6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:24.573891 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-26d5920c-6cb4-4a79-87d2-2a79c0a2ada6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:24.585805 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-26d5920c-6cb4-4a79-87d2-2a79c0a2ada6 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad" status: 200 len: 1678 microversion: 2.1 time: 0.156755 Aug 31 13:10:24.586572 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 454/881] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:10:24 2022] GET /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:10:24.636809 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-36093094-3077-4648-b8c1-afc9e4ec7592 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:10:24.637507 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-36093094-3077-4648-b8c1-afc9e4ec7592 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:10:24.645158 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-36093094-3077-4648-b8c1-afc9e4ec7592 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:24.645686 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-36093094-3077-4648-b8c1-afc9e4ec7592 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:24.646193 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-36093094-3077-4648-b8c1-afc9e4ec7592 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:24.646996 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-36093094-3077-4648-b8c1-afc9e4ec7592 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:24.647452 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-36093094-3077-4648-b8c1-afc9e4ec7592 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:24.647970 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-36093094-3077-4648-b8c1-afc9e4ec7592 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:24.785037 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-36093094-3077-4648-b8c1-afc9e4ec7592 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:24.798439 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-36093094-3077-4648-b8c1-afc9e4ec7592 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:24.799844 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-36093094-3077-4648-b8c1-afc9e4ec7592 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:24.801041 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-36093094-3077-4648-b8c1-afc9e4ec7592 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1807 microversion: 2.20 time: 0.168526 Aug 31 13:10:24.801630 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 428/882] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:10:24 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:10:25.606872 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-5426c265-1d52-4918-9e2b-da542acc896e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:10:25.607541 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-5426c265-1d52-4918-9e2b-da542acc896e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:10:25.614317 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5426c265-1d52-4918-9e2b-da542acc896e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:25.614903 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5426c265-1d52-4918-9e2b-da542acc896e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:25.615439 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5426c265-1d52-4918-9e2b-da542acc896e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:25.616281 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5426c265-1d52-4918-9e2b-da542acc896e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:25.616826 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5426c265-1d52-4918-9e2b-da542acc896e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:25.617322 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5426c265-1d52-4918-9e2b-da542acc896e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:25.764217 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-5426c265-1d52-4918-9e2b-da542acc896e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:25.773560 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-5426c265-1d52-4918-9e2b-da542acc896e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad" status: 200 len: 1678 microversion: 2.1 time: 0.170510 Aug 31 13:10:25.774142 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 455/883] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:10:25 2022] GET /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:10:25.824899 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-f1f4b5bb-3c70-49c7-a40e-7eb595066ed4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:10:25.825514 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-f1f4b5bb-3c70-49c7-a40e-7eb595066ed4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:10:25.832487 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f1f4b5bb-3c70-49c7-a40e-7eb595066ed4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:25.832939 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f1f4b5bb-3c70-49c7-a40e-7eb595066ed4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:25.833358 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f1f4b5bb-3c70-49c7-a40e-7eb595066ed4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:25.834027 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f1f4b5bb-3c70-49c7-a40e-7eb595066ed4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:25.834657 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f1f4b5bb-3c70-49c7-a40e-7eb595066ed4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:25.835071 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f1f4b5bb-3c70-49c7-a40e-7eb595066ed4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:25.976470 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-f1f4b5bb-3c70-49c7-a40e-7eb595066ed4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:25.986436 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-f1f4b5bb-3c70-49c7-a40e-7eb595066ed4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:25.988251 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-f1f4b5bb-3c70-49c7-a40e-7eb595066ed4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:25.989523 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-f1f4b5bb-3c70-49c7-a40e-7eb595066ed4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1807 microversion: 2.20 time: 0.168928 Aug 31 13:10:25.990171 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 429/884] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:10:25 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:10:26.795177 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-639a8880-6454-4592-9cc9-e10c20e22d91 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:10:26.795755 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-639a8880-6454-4592-9cc9-e10c20e22d91 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:10:26.802370 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-639a8880-6454-4592-9cc9-e10c20e22d91 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:26.802850 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-639a8880-6454-4592-9cc9-e10c20e22d91 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:26.803282 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-639a8880-6454-4592-9cc9-e10c20e22d91 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:26.804036 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-639a8880-6454-4592-9cc9-e10c20e22d91 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:26.804483 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-639a8880-6454-4592-9cc9-e10c20e22d91 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:26.804903 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-639a8880-6454-4592-9cc9-e10c20e22d91 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:26.946561 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-639a8880-6454-4592-9cc9-e10c20e22d91 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:26.954849 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-639a8880-6454-4592-9cc9-e10c20e22d91 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad" status: 200 len: 1678 microversion: 2.1 time: 0.163625 Aug 31 13:10:26.955438 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 456/885] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:10:26 2022] GET /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:10:27.012811 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-56b9af57-0f1e-4913-a007-6f94d1532012 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:10:27.013448 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-56b9af57-0f1e-4913-a007-6f94d1532012 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:10:27.020103 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-56b9af57-0f1e-4913-a007-6f94d1532012 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:27.020607 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-56b9af57-0f1e-4913-a007-6f94d1532012 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:27.021027 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-56b9af57-0f1e-4913-a007-6f94d1532012 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:27.021710 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-56b9af57-0f1e-4913-a007-6f94d1532012 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:27.022151 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-56b9af57-0f1e-4913-a007-6f94d1532012 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:27.022572 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-56b9af57-0f1e-4913-a007-6f94d1532012 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:27.159007 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-56b9af57-0f1e-4913-a007-6f94d1532012 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:27.168354 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-56b9af57-0f1e-4913-a007-6f94d1532012 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:27.169779 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-56b9af57-0f1e-4913-a007-6f94d1532012 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:27.170936 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-56b9af57-0f1e-4913-a007-6f94d1532012 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1794 microversion: 2.20 time: 0.162065 Aug 31 13:10:27.171501 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 430/886] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:10:27 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1794 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:10:27.910616 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-0b245ea8-4768-4fa1-8c8f-8b36b15f08ce req-49ed5df7-7e24-4a08-b6d1-f471b3eb2c4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92157027-9f9d-4c1a-8b0c-e7e5ad9253ad", "name": "network-vif-deleted", "tag": "ae061448-8f9b-4b03-b6a8-f247e6415329"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:10:27.920500 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_api:SELECT=46 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:10:27.923780 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-0b245ea8-4768-4fa1-8c8f-8b36b15f08ce req-49ed5df7-7e24-4a08-b6d1-f471b3eb2c4c service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:27.928301 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-0b245ea8-4768-4fa1-8c8f-8b36b15f08ce req-49ed5df7-7e24-4a08-b6d1-f471b3eb2c4c service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:27.931060 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-0b245ea8-4768-4fa1-8c8f-8b36b15f08ce req-49ed5df7-7e24-4a08-b6d1-f471b3eb2c4c service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:27.959500 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-0b245ea8-4768-4fa1-8c8f-8b36b15f08ce req-49ed5df7-7e24-4a08-b6d1-f471b3eb2c4c service nova] Creating event network-vif-deleted:ae061448-8f9b-4b03-b6a8-f247e6415329 for instance 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad on hv-cinder-85442 Aug 31 13:10:27.968448 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-0b245ea8-4768-4fa1-8c8f-8b36b15f08ce req-49ed5df7-7e24-4a08-b6d1-f471b3eb2c4c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.227815 Aug 31 13:10:27.970431 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 457/887] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:10:27.978072 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-4ee6e33d-23bc-4882-997a-fcb194f6061e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:10:27.978704 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-4ee6e33d-23bc-4882-997a-fcb194f6061e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:10:27.986011 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4ee6e33d-23bc-4882-997a-fcb194f6061e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:27.986157 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4ee6e33d-23bc-4882-997a-fcb194f6061e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:27.986668 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4ee6e33d-23bc-4882-997a-fcb194f6061e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:27.987388 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4ee6e33d-23bc-4882-997a-fcb194f6061e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:27.987885 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4ee6e33d-23bc-4882-997a-fcb194f6061e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:27.988312 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4ee6e33d-23bc-4882-997a-fcb194f6061e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:28.030800 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4ee6e33d-23bc-4882-997a-fcb194f6061e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:28.031513 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4ee6e33d-23bc-4882-997a-fcb194f6061e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:28.031706 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4ee6e33d-23bc-4882-997a-fcb194f6061e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:28.032388 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.objects.instance [None req-4ee6e33d-23bc-4882-997a-fcb194f6061e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lazy-loading 'fault' on Instance uuid 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad {{(pid=120705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 13:10:28.078157 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-4ee6e33d-23bc-4882-997a-fcb194f6061e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2a50988be24e20be034777225d8106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf85a7b31004baf848842ad2f74cbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:10:28.087994 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-4ee6e33d-23bc-4882-997a-fcb194f6061e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad" status: 200 len: 1331 microversion: 2.1 time: 0.115465 Aug 31 13:10:28.088599 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 431/888] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:10:27 2022] GET /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad => generated 1331 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:10:29.110431 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-fc379467-36b9-4b9b-88ae-91052682081f tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:10:29.110991 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-fc379467-36b9-4b9b-88ae-91052682081f tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:10:29.118389 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fc379467-36b9-4b9b-88ae-91052682081f tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:29.118862 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fc379467-36b9-4b9b-88ae-91052682081f tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:29.119294 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fc379467-36b9-4b9b-88ae-91052682081f tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:29.120017 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fc379467-36b9-4b9b-88ae-91052682081f tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:29.120463 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fc379467-36b9-4b9b-88ae-91052682081f tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:29.120879 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-fc379467-36b9-4b9b-88ae-91052682081f tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:29.134830 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.wsgi [None req-fc379467-36b9-4b9b-88ae-91052682081f tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] HTTP exception thrown: Instance 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad could not be found. Aug 31 13:10:29.136489 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-fc379467-36b9-4b9b-88ae-91052682081f tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Request method failure captured: Aug 31 13:10:29.136489 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: request: GET /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad HTTP/1.1 Aug 31 13:10:29.136489 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept: application/json Aug 31 13:10:29.136489 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept-Encoding: identity Aug 31 13:10:29.136489 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Connection: close Aug 31 13:10:29.136489 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Length: 0 Aug 31 13:10:29.136489 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Type: application/json Aug 31 13:10:29.136489 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Host: 10.222.0.58 Aug 31 13:10:29.136489 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Openstack-System-Scope: None Aug 31 13:10:29.136489 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: User-Agent: python-urllib3/1.26.12 Aug 31 13:10:29.136489 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Auth-Token: gAAAAABjD1uCNSnUQPMlQgFT2jq-eB19r7xLb94uzxGnoJXWTepSWTo7UQTZU86dPbIoFZ8qqdn2aU_O4yRfHOsmgtmeK9yuhxtC117CeRP8ROwyQq4z33BXiou8fAPjfT5vF29_iKZcD17NL5FwHgpz6cSqA2AiwZ_XLORdaExhfMVopvwp8pU Aug 31 13:10:29.136489 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Id: None Aug 31 13:10:29.136489 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Name: None Aug 31 13:10:29.136489 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Identity-Status: Confirmed Aug 31 13:10:29.136489 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Is-Admin-Project: True Aug 31 13:10:29.136489 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Id: default Aug 31 13:10:29.136489 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Name: Default Aug 31 13:10:29.136489 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Id: fdf85a7b31004baf848842ad2f74cbf0 Aug 31 13:10:29.136489 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Name: tempest-AttachVolumeNegativeTest-2039526226 Aug 31 13:10:29.136489 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Role: member,reader Aug 31 13:10:29.136489 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Roles: member,reader Aug 31 13:10:29.138175 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fdf85a7b31004baf848842ad2f74cbf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fdf85a7b31004baf848842ad2f74cbf0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fdf85a7b31004baf848842ad2f74cbf0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fdf85a7b31004baf848842ad2f74cbf0"}]}] Aug 31 13:10:29.138175 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant: tempest-AttachVolumeNegativeTest-2039526226 Aug 31 13:10:29.138175 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Id: fdf85a7b31004baf848842ad2f74cbf0 Aug 31 13:10:29.138175 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2039526226 Aug 31 13:10:29.138175 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User: tempest-AttachVolumeNegativeTest-2039526226-project Aug 31 13:10:29.138175 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Id: default Aug 31 13:10:29.138175 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Name: Default Aug 31 13:10:29.138175 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Id: ac2a50988be24e20be034777225d8106 Aug 31 13:10:29.138175 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Name: tempest-AttachVolumeNegativeTest-2039526226-project Aug 31 13:10:29.138175 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: method: > Aug 31 13:10:29.138175 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: exception: Instance 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad could not be found. Aug 31 13:10:29.138175 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: action_args: {'id': '92157027-9f9d-4c1a-8b0c-e7e5ad9253ad'} Aug 31 13:10:29.139197 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:10:29.139197 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:10:29.139197 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 13:10:29.139197 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 13:10:29.139197 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 13:10:29.139197 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 13:10:29.139197 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 13:10:29.139197 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 13:10:29.139197 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 13:10:29.139197 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 13:10:29.139197 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad could not be found. Aug 31 13:10:29.139197 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:10:29.139197 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:10:29.139197 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:10:29.139197 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:10:29.139197 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:10:29.139197 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:10:29.139197 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:10:29.139197 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:10:29.139197 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:10:29.140516 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:10:29.140516 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 13:10:29.140516 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 13:10:29.140516 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 13:10:29.140516 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 13:10:29.140516 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 13:10:29.140516 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 13:10:29.140516 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad could not be found. Aug 31 13:10:29.140516 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:10:29.140516 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:10:29.140516 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:10:29.140516 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:10:29.140516 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:10:29.140516 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:10:29.140516 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:10:29.140516 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:10:29.140516 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad could not be found. Aug 31 13:10:29.140516 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:10:29.141739 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-fc379467-36b9-4b9b-88ae-91052682081f tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Returning 404 to user: Instance 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad could not be found. {{(pid=120704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:10:29.141739 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-fc379467-36b9-4b9b-88ae-91052682081f tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad" status: 404 len: 111 microversion: 2.1 time: 0.031962 Aug 31 13:10:29.141739 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 458/889] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:10:29 2022] GET /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:10:29.147125 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e99156c1-8990-462d-8c25-0f90ad036feb tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '.version_select at 0x7f19512ac9d0>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:10:29.170999 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e99156c1-8990-462d-8c25-0f90ad036feb tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1176202852" status: 202 len: 0 microversion: 2.1 time: 0.027717 Aug 31 13:10:29.171590 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 432/890] 10.222.0.58 () {58 vars in 1221 bytes} [Wed Aug 31 13:10:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1176202852 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:10:30.951922 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-0caaa86d-3c81-4064-9dd1-4fcd614885e1 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:10:30.952479 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-0caaa86d-3c81-4064-9dd1-4fcd614885e1 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:10:30.959806 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0caaa86d-3c81-4064-9dd1-4fcd614885e1 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:30.960358 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0caaa86d-3c81-4064-9dd1-4fcd614885e1 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:30.960798 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0caaa86d-3c81-4064-9dd1-4fcd614885e1 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:30.961517 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0caaa86d-3c81-4064-9dd1-4fcd614885e1 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:30.961972 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0caaa86d-3c81-4064-9dd1-4fcd614885e1 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:30.962365 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0caaa86d-3c81-4064-9dd1-4fcd614885e1 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:30.978880 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.wsgi [None req-0caaa86d-3c81-4064-9dd1-4fcd614885e1 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] HTTP exception thrown: Instance 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad could not be found. Aug 31 13:10:30.980506 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-0caaa86d-3c81-4064-9dd1-4fcd614885e1 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Request method failure captured: Aug 31 13:10:30.980506 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: request: DELETE /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad HTTP/1.1 Aug 31 13:10:30.980506 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept: application/json Aug 31 13:10:30.980506 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept-Encoding: identity Aug 31 13:10:30.980506 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Connection: close Aug 31 13:10:30.980506 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Length: 0 Aug 31 13:10:30.980506 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Type: application/json Aug 31 13:10:30.980506 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Host: 10.222.0.58 Aug 31 13:10:30.980506 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Openstack-System-Scope: None Aug 31 13:10:30.980506 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: User-Agent: python-urllib3/1.26.12 Aug 31 13:10:30.980506 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Auth-Token: gAAAAABjD1uCNSnUQPMlQgFT2jq-eB19r7xLb94uzxGnoJXWTepSWTo7UQTZU86dPbIoFZ8qqdn2aU_O4yRfHOsmgtmeK9yuhxtC117CeRP8ROwyQq4z33BXiou8fAPjfT5vF29_iKZcD17NL5FwHgpz6cSqA2AiwZ_XLORdaExhfMVopvwp8pU Aug 31 13:10:30.980506 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Id: None Aug 31 13:10:30.980506 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Name: None Aug 31 13:10:30.980506 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Identity-Status: Confirmed Aug 31 13:10:30.980506 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Is-Admin-Project: True Aug 31 13:10:30.980506 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Id: default Aug 31 13:10:30.980506 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Name: Default Aug 31 13:10:30.980506 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Id: fdf85a7b31004baf848842ad2f74cbf0 Aug 31 13:10:30.980506 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Name: tempest-AttachVolumeNegativeTest-2039526226 Aug 31 13:10:30.980506 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Role: member,reader Aug 31 13:10:30.980506 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Roles: member,reader Aug 31 13:10:30.982046 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fdf85a7b31004baf848842ad2f74cbf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fdf85a7b31004baf848842ad2f74cbf0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fdf85a7b31004baf848842ad2f74cbf0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fdf85a7b31004baf848842ad2f74cbf0"}]}] Aug 31 13:10:30.982046 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant: tempest-AttachVolumeNegativeTest-2039526226 Aug 31 13:10:30.982046 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Id: fdf85a7b31004baf848842ad2f74cbf0 Aug 31 13:10:30.982046 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2039526226 Aug 31 13:10:30.982046 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User: tempest-AttachVolumeNegativeTest-2039526226-project Aug 31 13:10:30.982046 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Id: default Aug 31 13:10:30.982046 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Name: Default Aug 31 13:10:30.982046 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Id: ac2a50988be24e20be034777225d8106 Aug 31 13:10:30.982046 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Name: tempest-AttachVolumeNegativeTest-2039526226-project Aug 31 13:10:30.982046 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: method: > Aug 31 13:10:30.982046 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: exception: Instance 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad could not be found. Aug 31 13:10:30.982046 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: action_args: {'id': '92157027-9f9d-4c1a-8b0c-e7e5ad9253ad'} Aug 31 13:10:30.983008 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:10:30.983008 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:10:30.983008 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 13:10:30.983008 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 13:10:30.983008 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 13:10:30.983008 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 13:10:30.983008 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 13:10:30.983008 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 13:10:30.983008 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 13:10:30.983008 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 13:10:30.983008 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad could not be found. Aug 31 13:10:30.983008 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:10:30.983008 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:10:30.983008 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:10:30.983008 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:10:30.983008 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:10:30.983008 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:10:30.983008 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:10:30.983008 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:10:30.983008 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:10:30.984580 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:10:30.984580 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 13:10:30.984580 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 13:10:30.984580 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 13:10:30.984580 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 13:10:30.984580 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 13:10:30.984580 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 13:10:30.984580 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 13:10:30.984580 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 13:10:30.984580 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad could not be found. Aug 31 13:10:30.984580 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:10:30.984580 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:10:30.984580 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:10:30.984580 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:10:30.984580 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:10:30.984580 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:10:30.984580 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:10:30.984580 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:10:30.984580 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad could not be found. Aug 31 13:10:30.984580 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:10:30.986341 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-0caaa86d-3c81-4064-9dd1-4fcd614885e1 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Returning 404 to user: Instance 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad could not be found. {{(pid=120704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:10:30.986341 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-0caaa86d-3c81-4064-9dd1-4fcd614885e1 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "DELETE /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad" status: 404 len: 111 microversion: 2.1 time: 0.034252 Aug 31 13:10:30.986341 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 459/891] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 31 13:10:30 2022] DELETE /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:10:30.991124 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-d3e849d6-9591-4477-a347-1946d1c72593 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:10:30.991727 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-d3e849d6-9591-4477-a347-1946d1c72593 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:10:30.998868 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d3e849d6-9591-4477-a347-1946d1c72593 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:30.999347 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d3e849d6-9591-4477-a347-1946d1c72593 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:30.999783 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d3e849d6-9591-4477-a347-1946d1c72593 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:31.000507 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d3e849d6-9591-4477-a347-1946d1c72593 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:31.000956 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d3e849d6-9591-4477-a347-1946d1c72593 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:31.001378 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d3e849d6-9591-4477-a347-1946d1c72593 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:31.005534 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:10:31.015423 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-d3e849d6-9591-4477-a347-1946d1c72593 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] HTTP exception thrown: Instance 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad could not be found. Aug 31 13:10:31.017181 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-d3e849d6-9591-4477-a347-1946d1c72593 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Request method failure captured: Aug 31 13:10:31.017181 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: request: GET /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad HTTP/1.1 Aug 31 13:10:31.017181 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 31 13:10:31.017181 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 31 13:10:31.017181 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Connection: close Aug 31 13:10:31.017181 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 31 13:10:31.017181 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 31 13:10:31.017181 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Host: 10.222.0.58 Aug 31 13:10:31.017181 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 31 13:10:31.017181 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 31 13:10:31.017181 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjD1uCNSnUQPMlQgFT2jq-eB19r7xLb94uzxGnoJXWTepSWTo7UQTZU86dPbIoFZ8qqdn2aU_O4yRfHOsmgtmeK9yuhxtC117CeRP8ROwyQq4z33BXiou8fAPjfT5vF29_iKZcD17NL5FwHgpz6cSqA2AiwZ_XLORdaExhfMVopvwp8pU Aug 31 13:10:31.017181 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 31 13:10:31.017181 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 31 13:10:31.017181 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 31 13:10:31.017181 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 31 13:10:31.017181 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 31 13:10:31.017181 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 31 13:10:31.017181 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Id: fdf85a7b31004baf848842ad2f74cbf0 Aug 31 13:10:31.017181 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-AttachVolumeNegativeTest-2039526226 Aug 31 13:10:31.017181 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Role: member,reader Aug 31 13:10:31.017181 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Roles: member,reader Aug 31 13:10:31.018726 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fdf85a7b31004baf848842ad2f74cbf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fdf85a7b31004baf848842ad2f74cbf0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fdf85a7b31004baf848842ad2f74cbf0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fdf85a7b31004baf848842ad2f74cbf0"}]}] Aug 31 13:10:31.018726 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-AttachVolumeNegativeTest-2039526226 Aug 31 13:10:31.018726 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant-Id: fdf85a7b31004baf848842ad2f74cbf0 Aug 31 13:10:31.018726 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2039526226 Aug 31 13:10:31.018726 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User: tempest-AttachVolumeNegativeTest-2039526226-project Aug 31 13:10:31.018726 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 31 13:10:31.018726 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 31 13:10:31.018726 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Id: ac2a50988be24e20be034777225d8106 Aug 31 13:10:31.018726 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-AttachVolumeNegativeTest-2039526226-project Aug 31 13:10:31.018726 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: method: > Aug 31 13:10:31.018726 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: exception: Instance 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad could not be found. Aug 31 13:10:31.018726 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: action_args: {'id': '92157027-9f9d-4c1a-8b0c-e7e5ad9253ad'} Aug 31 13:10:31.023120 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:10:31.023120 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:10:31.023120 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 13:10:31.023120 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 13:10:31.023120 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 13:10:31.023120 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 13:10:31.023120 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 13:10:31.023120 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 13:10:31.023120 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 13:10:31.023120 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 13:10:31.023120 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad could not be found. Aug 31 13:10:31.023120 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:10:31.023120 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:10:31.023120 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:10:31.023120 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:10:31.023120 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:10:31.023120 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:10:31.023120 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:10:31.023120 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:10:31.023120 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:10:31.024597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:10:31.024597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 13:10:31.024597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 13:10:31.024597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 13:10:31.024597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 13:10:31.024597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 13:10:31.024597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 13:10:31.024597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad could not be found. Aug 31 13:10:31.024597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:10:31.024597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:10:31.024597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:10:31.024597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:10:31.024597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:10:31.024597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:10:31.024597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:10:31.024597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:10:31.024597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad could not be found. Aug 31 13:10:31.024597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:10:31.025963 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-d3e849d6-9591-4477-a347-1946d1c72593 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Returning 404 to user: Instance 92157027-9f9d-4c1a-8b0c-e7e5ad9253ad could not be found. {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:10:31.025963 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-d3e849d6-9591-4477-a347-1946d1c72593 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad" status: 404 len: 111 microversion: 2.1 time: 0.032015 Aug 31 13:10:31.025963 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 433/892] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:10:30 2022] GET /compute/v2.1/servers/92157027-9f9d-4c1a-8b0c-e7e5ad9253ad => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:10:32.164486 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-384b3bbd-396f-45b4-a8b9-fa989f385220 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:10:32.165006 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-384b3bbd-396f-45b4-a8b9-fa989f385220 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 57462145-0049-4cce-87cf-698a1ebbbee3] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:10:32.172173 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-384b3bbd-396f-45b4-a8b9-fa989f385220 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:32.172828 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-384b3bbd-396f-45b4-a8b9-fa989f385220 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:32.173258 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-384b3bbd-396f-45b4-a8b9-fa989f385220 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:32.173948 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-384b3bbd-396f-45b4-a8b9-fa989f385220 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:32.174391 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-384b3bbd-396f-45b4-a8b9-fa989f385220 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:32.174812 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-384b3bbd-396f-45b4-a8b9-fa989f385220 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:32.188590 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.wsgi [None req-384b3bbd-396f-45b4-a8b9-fa989f385220 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] HTTP exception thrown: Instance 57462145-0049-4cce-87cf-698a1ebbbee3 could not be found. Aug 31 13:10:32.190126 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-384b3bbd-396f-45b4-a8b9-fa989f385220 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Request method failure captured: Aug 31 13:10:32.190126 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: request: DELETE /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3 HTTP/1.1 Aug 31 13:10:32.190126 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept: application/json Aug 31 13:10:32.190126 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept-Encoding: identity Aug 31 13:10:32.190126 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Connection: close Aug 31 13:10:32.190126 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Length: 0 Aug 31 13:10:32.190126 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Type: application/json Aug 31 13:10:32.190126 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Host: 10.222.0.58 Aug 31 13:10:32.190126 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Openstack-System-Scope: None Aug 31 13:10:32.190126 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: User-Agent: python-urllib3/1.26.12 Aug 31 13:10:32.190126 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Auth-Token: gAAAAABjD1uCNSnUQPMlQgFT2jq-eB19r7xLb94uzxGnoJXWTepSWTo7UQTZU86dPbIoFZ8qqdn2aU_O4yRfHOsmgtmeK9yuhxtC117CeRP8ROwyQq4z33BXiou8fAPjfT5vF29_iKZcD17NL5FwHgpz6cSqA2AiwZ_XLORdaExhfMVopvwp8pU Aug 31 13:10:32.190126 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Id: None Aug 31 13:10:32.190126 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Name: None Aug 31 13:10:32.190126 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Identity-Status: Confirmed Aug 31 13:10:32.190126 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Is-Admin-Project: True Aug 31 13:10:32.190126 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Id: default Aug 31 13:10:32.190126 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Name: Default Aug 31 13:10:32.190126 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Id: fdf85a7b31004baf848842ad2f74cbf0 Aug 31 13:10:32.190126 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Name: tempest-AttachVolumeNegativeTest-2039526226 Aug 31 13:10:32.190126 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Role: member,reader Aug 31 13:10:32.190126 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Roles: member,reader Aug 31 13:10:32.191689 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fdf85a7b31004baf848842ad2f74cbf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fdf85a7b31004baf848842ad2f74cbf0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fdf85a7b31004baf848842ad2f74cbf0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fdf85a7b31004baf848842ad2f74cbf0"}]}] Aug 31 13:10:32.191689 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant: tempest-AttachVolumeNegativeTest-2039526226 Aug 31 13:10:32.191689 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Id: fdf85a7b31004baf848842ad2f74cbf0 Aug 31 13:10:32.191689 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2039526226 Aug 31 13:10:32.191689 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User: tempest-AttachVolumeNegativeTest-2039526226-project Aug 31 13:10:32.191689 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Id: default Aug 31 13:10:32.191689 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Name: Default Aug 31 13:10:32.191689 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Id: ac2a50988be24e20be034777225d8106 Aug 31 13:10:32.191689 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Name: tempest-AttachVolumeNegativeTest-2039526226-project Aug 31 13:10:32.191689 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: method: > Aug 31 13:10:32.191689 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: exception: Instance 57462145-0049-4cce-87cf-698a1ebbbee3 could not be found. Aug 31 13:10:32.191689 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: action_args: {'id': '57462145-0049-4cce-87cf-698a1ebbbee3'} Aug 31 13:10:32.192643 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:10:32.192643 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:10:32.192643 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 13:10:32.192643 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 13:10:32.192643 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 13:10:32.192643 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 13:10:32.192643 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 13:10:32.192643 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 13:10:32.192643 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 13:10:32.192643 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 13:10:32.192643 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57462145-0049-4cce-87cf-698a1ebbbee3 could not be found. Aug 31 13:10:32.192643 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:10:32.192643 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:10:32.192643 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:10:32.192643 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:10:32.192643 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:10:32.192643 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:10:32.192643 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:10:32.192643 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:10:32.192643 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:10:32.194174 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:10:32.194174 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 13:10:32.194174 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 13:10:32.194174 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 13:10:32.194174 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 13:10:32.194174 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 13:10:32.194174 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 13:10:32.194174 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 13:10:32.194174 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 13:10:32.194174 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57462145-0049-4cce-87cf-698a1ebbbee3 could not be found. Aug 31 13:10:32.194174 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:10:32.194174 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:10:32.194174 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:10:32.194174 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:10:32.194174 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:10:32.194174 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:10:32.194174 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:10:32.194174 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:10:32.194174 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57462145-0049-4cce-87cf-698a1ebbbee3 could not be found. Aug 31 13:10:32.194174 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:10:32.195933 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-384b3bbd-396f-45b4-a8b9-fa989f385220 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Returning 404 to user: Instance 57462145-0049-4cce-87cf-698a1ebbbee3 could not be found. {{(pid=120704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:10:32.195933 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-384b3bbd-396f-45b4-a8b9-fa989f385220 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "DELETE /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3" status: 404 len: 111 microversion: 2.1 time: 0.030955 Aug 31 13:10:32.195933 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 460/893] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 31 13:10:32 2022] DELETE /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:10:32.202318 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b68b017a-98e0-40d8-84b1-f93e8d60b420 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:10:32.202928 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b68b017a-98e0-40d8-84b1-f93e8d60b420 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: 57462145-0049-4cce-87cf-698a1ebbbee3] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:10:32.209960 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b68b017a-98e0-40d8-84b1-f93e8d60b420 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:32.210439 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b68b017a-98e0-40d8-84b1-f93e8d60b420 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:32.210871 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b68b017a-98e0-40d8-84b1-f93e8d60b420 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:32.211566 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b68b017a-98e0-40d8-84b1-f93e8d60b420 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:32.212063 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b68b017a-98e0-40d8-84b1-f93e8d60b420 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:32.212481 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b68b017a-98e0-40d8-84b1-f93e8d60b420 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:32.227370 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-b68b017a-98e0-40d8-84b1-f93e8d60b420 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] HTTP exception thrown: Instance 57462145-0049-4cce-87cf-698a1ebbbee3 could not be found. Aug 31 13:10:32.228981 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b68b017a-98e0-40d8-84b1-f93e8d60b420 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Request method failure captured: Aug 31 13:10:32.228981 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: request: GET /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3 HTTP/1.1 Aug 31 13:10:32.228981 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 31 13:10:32.228981 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 31 13:10:32.228981 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Connection: close Aug 31 13:10:32.228981 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 31 13:10:32.228981 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 31 13:10:32.228981 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Host: 10.222.0.58 Aug 31 13:10:32.228981 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 31 13:10:32.228981 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 31 13:10:32.228981 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjD1uCNSnUQPMlQgFT2jq-eB19r7xLb94uzxGnoJXWTepSWTo7UQTZU86dPbIoFZ8qqdn2aU_O4yRfHOsmgtmeK9yuhxtC117CeRP8ROwyQq4z33BXiou8fAPjfT5vF29_iKZcD17NL5FwHgpz6cSqA2AiwZ_XLORdaExhfMVopvwp8pU Aug 31 13:10:32.228981 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 31 13:10:32.228981 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 31 13:10:32.228981 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 31 13:10:32.228981 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 31 13:10:32.228981 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 31 13:10:32.228981 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 31 13:10:32.228981 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Id: fdf85a7b31004baf848842ad2f74cbf0 Aug 31 13:10:32.228981 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-AttachVolumeNegativeTest-2039526226 Aug 31 13:10:32.228981 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Role: member,reader Aug 31 13:10:32.228981 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Roles: member,reader Aug 31 13:10:32.230527 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fdf85a7b31004baf848842ad2f74cbf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fdf85a7b31004baf848842ad2f74cbf0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fdf85a7b31004baf848842ad2f74cbf0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fdf85a7b31004baf848842ad2f74cbf0"}]}] Aug 31 13:10:32.230527 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-AttachVolumeNegativeTest-2039526226 Aug 31 13:10:32.230527 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant-Id: fdf85a7b31004baf848842ad2f74cbf0 Aug 31 13:10:32.230527 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2039526226 Aug 31 13:10:32.230527 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User: tempest-AttachVolumeNegativeTest-2039526226-project Aug 31 13:10:32.230527 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 31 13:10:32.230527 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 31 13:10:32.230527 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Id: ac2a50988be24e20be034777225d8106 Aug 31 13:10:32.230527 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-AttachVolumeNegativeTest-2039526226-project Aug 31 13:10:32.230527 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: method: > Aug 31 13:10:32.230527 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: exception: Instance 57462145-0049-4cce-87cf-698a1ebbbee3 could not be found. Aug 31 13:10:32.230527 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: action_args: {'id': '57462145-0049-4cce-87cf-698a1ebbbee3'} Aug 31 13:10:32.231539 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:10:32.231539 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:10:32.231539 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 13:10:32.231539 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 13:10:32.231539 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 13:10:32.231539 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 13:10:32.231539 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 13:10:32.231539 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 13:10:32.231539 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 13:10:32.231539 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 13:10:32.231539 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57462145-0049-4cce-87cf-698a1ebbbee3 could not be found. Aug 31 13:10:32.231539 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:10:32.231539 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:10:32.231539 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:10:32.231539 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:10:32.231539 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:10:32.231539 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:10:32.231539 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:10:32.231539 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:10:32.231539 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:10:32.232945 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:10:32.232945 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 13:10:32.232945 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 13:10:32.232945 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 13:10:32.232945 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 13:10:32.232945 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 13:10:32.232945 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 13:10:32.232945 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57462145-0049-4cce-87cf-698a1ebbbee3 could not be found. Aug 31 13:10:32.232945 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:10:32.232945 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:10:32.232945 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:10:32.232945 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:10:32.232945 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:10:32.232945 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:10:32.232945 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:10:32.232945 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:10:32.232945 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57462145-0049-4cce-87cf-698a1ebbbee3 could not be found. Aug 31 13:10:32.232945 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:10:32.234229 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b68b017a-98e0-40d8-84b1-f93e8d60b420 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Returning 404 to user: Instance 57462145-0049-4cce-87cf-698a1ebbbee3 could not be found. {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:10:32.234229 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b68b017a-98e0-40d8-84b1-f93e8d60b420 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3" status: 404 len: 111 microversion: 2.1 time: 0.032803 Aug 31 13:10:32.234229 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 434/894] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:10:32 2022] GET /compute/v2.1/servers/57462145-0049-4cce-87cf-698a1ebbbee3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:10:32.239254 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-d906bdd5-5add-41d6-be37-dad424b42f0e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:10:32.239743 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-d906bdd5-5add-41d6-be37-dad424b42f0e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:10:32.246217 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d906bdd5-5add-41d6-be37-dad424b42f0e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:32.246692 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d906bdd5-5add-41d6-be37-dad424b42f0e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:32.247117 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d906bdd5-5add-41d6-be37-dad424b42f0e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:32.247802 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d906bdd5-5add-41d6-be37-dad424b42f0e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:32.248291 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d906bdd5-5add-41d6-be37-dad424b42f0e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:32.248706 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d906bdd5-5add-41d6-be37-dad424b42f0e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:32.262357 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.wsgi [None req-d906bdd5-5add-41d6-be37-dad424b42f0e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] HTTP exception thrown: Instance ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e could not be found. Aug 31 13:10:32.263927 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-d906bdd5-5add-41d6-be37-dad424b42f0e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Request method failure captured: Aug 31 13:10:32.263927 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: request: DELETE /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e HTTP/1.1 Aug 31 13:10:32.263927 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept: application/json Aug 31 13:10:32.263927 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept-Encoding: identity Aug 31 13:10:32.263927 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Connection: close Aug 31 13:10:32.263927 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Length: 0 Aug 31 13:10:32.263927 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Type: application/json Aug 31 13:10:32.263927 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Host: 10.222.0.58 Aug 31 13:10:32.263927 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Openstack-System-Scope: None Aug 31 13:10:32.263927 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: User-Agent: python-urllib3/1.26.12 Aug 31 13:10:32.263927 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Auth-Token: gAAAAABjD1uCNSnUQPMlQgFT2jq-eB19r7xLb94uzxGnoJXWTepSWTo7UQTZU86dPbIoFZ8qqdn2aU_O4yRfHOsmgtmeK9yuhxtC117CeRP8ROwyQq4z33BXiou8fAPjfT5vF29_iKZcD17NL5FwHgpz6cSqA2AiwZ_XLORdaExhfMVopvwp8pU Aug 31 13:10:32.263927 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Id: None Aug 31 13:10:32.263927 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Name: None Aug 31 13:10:32.263927 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Identity-Status: Confirmed Aug 31 13:10:32.263927 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Is-Admin-Project: True Aug 31 13:10:32.263927 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Id: default Aug 31 13:10:32.263927 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Name: Default Aug 31 13:10:32.263927 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Id: fdf85a7b31004baf848842ad2f74cbf0 Aug 31 13:10:32.263927 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Name: tempest-AttachVolumeNegativeTest-2039526226 Aug 31 13:10:32.263927 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Role: member,reader Aug 31 13:10:32.263927 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Roles: member,reader Aug 31 13:10:32.265514 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fdf85a7b31004baf848842ad2f74cbf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fdf85a7b31004baf848842ad2f74cbf0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fdf85a7b31004baf848842ad2f74cbf0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fdf85a7b31004baf848842ad2f74cbf0"}]}] Aug 31 13:10:32.265514 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant: tempest-AttachVolumeNegativeTest-2039526226 Aug 31 13:10:32.265514 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Id: fdf85a7b31004baf848842ad2f74cbf0 Aug 31 13:10:32.265514 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2039526226 Aug 31 13:10:32.265514 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User: tempest-AttachVolumeNegativeTest-2039526226-project Aug 31 13:10:32.265514 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Id: default Aug 31 13:10:32.265514 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Name: Default Aug 31 13:10:32.265514 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Id: ac2a50988be24e20be034777225d8106 Aug 31 13:10:32.265514 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Name: tempest-AttachVolumeNegativeTest-2039526226-project Aug 31 13:10:32.265514 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: method: > Aug 31 13:10:32.265514 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: exception: Instance ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e could not be found. Aug 31 13:10:32.265514 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: action_args: {'id': 'ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e'} Aug 31 13:10:32.266548 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:10:32.266548 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:10:32.266548 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 13:10:32.266548 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 13:10:32.266548 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 13:10:32.266548 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 13:10:32.266548 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 13:10:32.266548 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 13:10:32.266548 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 13:10:32.266548 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 13:10:32.266548 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e could not be found. Aug 31 13:10:32.266548 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:10:32.266548 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:10:32.266548 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:10:32.266548 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:10:32.266548 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:10:32.266548 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:10:32.266548 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:10:32.266548 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:10:32.266548 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:10:32.268188 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:10:32.268188 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 13:10:32.268188 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 13:10:32.268188 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 13:10:32.268188 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 13:10:32.268188 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 13:10:32.268188 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 13:10:32.268188 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 13:10:32.268188 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 13:10:32.268188 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e could not be found. Aug 31 13:10:32.268188 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:10:32.268188 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:10:32.268188 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:10:32.268188 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:10:32.268188 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:10:32.268188 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:10:32.268188 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:10:32.268188 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:10:32.268188 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e could not be found. Aug 31 13:10:32.268188 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:10:32.270098 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-d906bdd5-5add-41d6-be37-dad424b42f0e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Returning 404 to user: Instance ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e could not be found. {{(pid=120704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:10:32.270098 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-d906bdd5-5add-41d6-be37-dad424b42f0e tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e" status: 404 len: 111 microversion: 2.1 time: 0.030052 Aug 31 13:10:32.270098 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 461/895] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 31 13:10:32 2022] DELETE /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 13:10:32.273883 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3e00631f-75ad-41f6-bb42-2559c34cdf2c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:10:32.274495 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-3e00631f-75ad-41f6-bb42-2559c34cdf2c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:10:32.281265 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3e00631f-75ad-41f6-bb42-2559c34cdf2c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:32.281746 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3e00631f-75ad-41f6-bb42-2559c34cdf2c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:32.282173 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3e00631f-75ad-41f6-bb42-2559c34cdf2c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:32.282853 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3e00631f-75ad-41f6-bb42-2559c34cdf2c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:32.283295 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3e00631f-75ad-41f6-bb42-2559c34cdf2c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:32.283711 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3e00631f-75ad-41f6-bb42-2559c34cdf2c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:32.297276 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-3e00631f-75ad-41f6-bb42-2559c34cdf2c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] HTTP exception thrown: Instance ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e could not be found. Aug 31 13:10:32.298769 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3e00631f-75ad-41f6-bb42-2559c34cdf2c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Request method failure captured: Aug 31 13:10:32.298769 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: request: GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e HTTP/1.1 Aug 31 13:10:32.298769 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 31 13:10:32.298769 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 31 13:10:32.298769 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Connection: close Aug 31 13:10:32.298769 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 31 13:10:32.298769 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 31 13:10:32.298769 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Host: 10.222.0.58 Aug 31 13:10:32.298769 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 31 13:10:32.298769 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 31 13:10:32.298769 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjD1uCNSnUQPMlQgFT2jq-eB19r7xLb94uzxGnoJXWTepSWTo7UQTZU86dPbIoFZ8qqdn2aU_O4yRfHOsmgtmeK9yuhxtC117CeRP8ROwyQq4z33BXiou8fAPjfT5vF29_iKZcD17NL5FwHgpz6cSqA2AiwZ_XLORdaExhfMVopvwp8pU Aug 31 13:10:32.298769 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 31 13:10:32.298769 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 31 13:10:32.298769 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 31 13:10:32.298769 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 31 13:10:32.298769 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 31 13:10:32.298769 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 31 13:10:32.298769 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Id: fdf85a7b31004baf848842ad2f74cbf0 Aug 31 13:10:32.298769 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-AttachVolumeNegativeTest-2039526226 Aug 31 13:10:32.298769 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Role: member,reader Aug 31 13:10:32.298769 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Roles: member,reader Aug 31 13:10:32.300334 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fdf85a7b31004baf848842ad2f74cbf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fdf85a7b31004baf848842ad2f74cbf0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fdf85a7b31004baf848842ad2f74cbf0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fdf85a7b31004baf848842ad2f74cbf0"}]}] Aug 31 13:10:32.300334 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-AttachVolumeNegativeTest-2039526226 Aug 31 13:10:32.300334 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant-Id: fdf85a7b31004baf848842ad2f74cbf0 Aug 31 13:10:32.300334 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2039526226 Aug 31 13:10:32.300334 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User: tempest-AttachVolumeNegativeTest-2039526226-project Aug 31 13:10:32.300334 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 31 13:10:32.300334 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 31 13:10:32.300334 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Id: ac2a50988be24e20be034777225d8106 Aug 31 13:10:32.300334 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-AttachVolumeNegativeTest-2039526226-project Aug 31 13:10:32.300334 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: method: > Aug 31 13:10:32.300334 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: exception: Instance ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e could not be found. Aug 31 13:10:32.300334 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: action_args: {'id': 'ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e'} Aug 31 13:10:32.301213 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:10:32.301213 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:10:32.301213 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 13:10:32.301213 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 13:10:32.301213 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 13:10:32.301213 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 13:10:32.301213 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 13:10:32.301213 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 13:10:32.301213 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 13:10:32.301213 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 13:10:32.301213 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e could not be found. Aug 31 13:10:32.301213 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:10:32.301213 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:10:32.301213 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:10:32.301213 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:10:32.301213 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:10:32.301213 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:10:32.301213 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:10:32.301213 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:10:32.301213 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:10:32.302690 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:10:32.302690 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 13:10:32.302690 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 13:10:32.302690 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 13:10:32.302690 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 13:10:32.302690 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 13:10:32.302690 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 13:10:32.302690 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e could not be found. Aug 31 13:10:32.302690 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:10:32.302690 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:10:32.302690 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:10:32.302690 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:10:32.302690 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:10:32.302690 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:10:32.302690 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:10:32.302690 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:10:32.302690 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e could not be found. Aug 31 13:10:32.302690 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:10:32.303985 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3e00631f-75ad-41f6-bb42-2559c34cdf2c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Returning 404 to user: Instance ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e could not be found. {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:10:32.303985 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-3e00631f-75ad-41f6-bb42-2559c34cdf2c tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e" status: 404 len: 111 microversion: 2.1 time: 0.030182 Aug 31 13:10:32.303985 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 435/896] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:10:32 2022] GET /compute/v2.1/servers/ef8b3825-3a8c-4eec-8ea2-f73e1c994b8e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 13:10:33.452788 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-91a309fb-70b3-4434-9869-fc4a9814ce7d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:10:33.453307 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-91a309fb-70b3-4434-9869-fc4a9814ce7d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ba62b7ce-5880-4281-a5a4-020d70e5b16d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:10:33.460301 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-91a309fb-70b3-4434-9869-fc4a9814ce7d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:33.460782 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-91a309fb-70b3-4434-9869-fc4a9814ce7d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:33.461218 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-91a309fb-70b3-4434-9869-fc4a9814ce7d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:33.461903 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-91a309fb-70b3-4434-9869-fc4a9814ce7d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:33.462353 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-91a309fb-70b3-4434-9869-fc4a9814ce7d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:33.462774 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-91a309fb-70b3-4434-9869-fc4a9814ce7d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:33.477590 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.wsgi [None req-91a309fb-70b3-4434-9869-fc4a9814ce7d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] HTTP exception thrown: Instance ba62b7ce-5880-4281-a5a4-020d70e5b16d could not be found. Aug 31 13:10:33.479147 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-91a309fb-70b3-4434-9869-fc4a9814ce7d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Request method failure captured: Aug 31 13:10:33.479147 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: request: DELETE /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d HTTP/1.1 Aug 31 13:10:33.479147 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept: application/json Aug 31 13:10:33.479147 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept-Encoding: identity Aug 31 13:10:33.479147 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Connection: close Aug 31 13:10:33.479147 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Length: 0 Aug 31 13:10:33.479147 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Type: application/json Aug 31 13:10:33.479147 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Host: 10.222.0.58 Aug 31 13:10:33.479147 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Openstack-System-Scope: None Aug 31 13:10:33.479147 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: User-Agent: python-urllib3/1.26.12 Aug 31 13:10:33.479147 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Auth-Token: gAAAAABjD1uCNSnUQPMlQgFT2jq-eB19r7xLb94uzxGnoJXWTepSWTo7UQTZU86dPbIoFZ8qqdn2aU_O4yRfHOsmgtmeK9yuhxtC117CeRP8ROwyQq4z33BXiou8fAPjfT5vF29_iKZcD17NL5FwHgpz6cSqA2AiwZ_XLORdaExhfMVopvwp8pU Aug 31 13:10:33.479147 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Id: None Aug 31 13:10:33.479147 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Name: None Aug 31 13:10:33.479147 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Identity-Status: Confirmed Aug 31 13:10:33.479147 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Is-Admin-Project: True Aug 31 13:10:33.479147 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Id: default Aug 31 13:10:33.479147 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Name: Default Aug 31 13:10:33.479147 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Id: fdf85a7b31004baf848842ad2f74cbf0 Aug 31 13:10:33.479147 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Name: tempest-AttachVolumeNegativeTest-2039526226 Aug 31 13:10:33.479147 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Role: member,reader Aug 31 13:10:33.479147 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Roles: member,reader Aug 31 13:10:33.480905 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fdf85a7b31004baf848842ad2f74cbf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fdf85a7b31004baf848842ad2f74cbf0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fdf85a7b31004baf848842ad2f74cbf0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fdf85a7b31004baf848842ad2f74cbf0"}]}] Aug 31 13:10:33.480905 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant: tempest-AttachVolumeNegativeTest-2039526226 Aug 31 13:10:33.480905 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Id: fdf85a7b31004baf848842ad2f74cbf0 Aug 31 13:10:33.480905 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2039526226 Aug 31 13:10:33.480905 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User: tempest-AttachVolumeNegativeTest-2039526226-project Aug 31 13:10:33.480905 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Id: default Aug 31 13:10:33.480905 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Name: Default Aug 31 13:10:33.480905 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Id: ac2a50988be24e20be034777225d8106 Aug 31 13:10:33.480905 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Name: tempest-AttachVolumeNegativeTest-2039526226-project Aug 31 13:10:33.480905 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: method: > Aug 31 13:10:33.480905 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: exception: Instance ba62b7ce-5880-4281-a5a4-020d70e5b16d could not be found. Aug 31 13:10:33.480905 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: action_args: {'id': 'ba62b7ce-5880-4281-a5a4-020d70e5b16d'} Aug 31 13:10:33.481749 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:10:33.481749 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:10:33.481749 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 13:10:33.481749 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 13:10:33.481749 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 13:10:33.481749 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 13:10:33.481749 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 13:10:33.481749 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 13:10:33.481749 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 13:10:33.481749 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 13:10:33.481749 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba62b7ce-5880-4281-a5a4-020d70e5b16d could not be found. Aug 31 13:10:33.481749 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:10:33.481749 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:10:33.481749 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:10:33.481749 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:10:33.481749 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:10:33.481749 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:10:33.481749 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:10:33.481749 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:10:33.481749 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:10:33.483153 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:10:33.483153 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 13:10:33.483153 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 13:10:33.483153 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 13:10:33.483153 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 13:10:33.483153 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 13:10:33.483153 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 13:10:33.483153 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 13:10:33.483153 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 13:10:33.483153 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba62b7ce-5880-4281-a5a4-020d70e5b16d could not be found. Aug 31 13:10:33.483153 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:10:33.483153 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:10:33.483153 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:10:33.483153 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:10:33.483153 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:10:33.483153 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:10:33.483153 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:10:33.483153 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:10:33.483153 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba62b7ce-5880-4281-a5a4-020d70e5b16d could not be found. Aug 31 13:10:33.483153 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:10:33.484640 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-91a309fb-70b3-4434-9869-fc4a9814ce7d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Returning 404 to user: Instance ba62b7ce-5880-4281-a5a4-020d70e5b16d could not be found. {{(pid=120704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:10:33.484640 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-91a309fb-70b3-4434-9869-fc4a9814ce7d tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d" status: 404 len: 111 microversion: 2.1 time: 0.031722 Aug 31 13:10:33.484640 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 462/897] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 31 13:10:33 2022] DELETE /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:10:33.489628 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-94c60dfa-774a-42c7-9b1f-11c59f7219b9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:10:33.490241 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-94c60dfa-774a-42c7-9b1f-11c59f7219b9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] [instance: ba62b7ce-5880-4281-a5a4-020d70e5b16d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:10:33.497106 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-94c60dfa-774a-42c7-9b1f-11c59f7219b9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:33.497592 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-94c60dfa-774a-42c7-9b1f-11c59f7219b9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:33.497997 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-94c60dfa-774a-42c7-9b1f-11c59f7219b9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:33.498925 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-94c60dfa-774a-42c7-9b1f-11c59f7219b9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:10:33.499397 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-94c60dfa-774a-42c7-9b1f-11c59f7219b9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:10:33.499793 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-94c60dfa-774a-42c7-9b1f-11c59f7219b9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:10:33.514445 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-94c60dfa-774a-42c7-9b1f-11c59f7219b9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] HTTP exception thrown: Instance ba62b7ce-5880-4281-a5a4-020d70e5b16d could not be found. Aug 31 13:10:33.516016 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-94c60dfa-774a-42c7-9b1f-11c59f7219b9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Request method failure captured: Aug 31 13:10:33.516016 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: request: GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d HTTP/1.1 Aug 31 13:10:33.516016 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 31 13:10:33.516016 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 31 13:10:33.516016 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Connection: close Aug 31 13:10:33.516016 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 31 13:10:33.516016 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 31 13:10:33.516016 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Host: 10.222.0.58 Aug 31 13:10:33.516016 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 31 13:10:33.516016 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 31 13:10:33.516016 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjD1uCNSnUQPMlQgFT2jq-eB19r7xLb94uzxGnoJXWTepSWTo7UQTZU86dPbIoFZ8qqdn2aU_O4yRfHOsmgtmeK9yuhxtC117CeRP8ROwyQq4z33BXiou8fAPjfT5vF29_iKZcD17NL5FwHgpz6cSqA2AiwZ_XLORdaExhfMVopvwp8pU Aug 31 13:10:33.516016 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 31 13:10:33.516016 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 31 13:10:33.516016 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 31 13:10:33.516016 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 31 13:10:33.516016 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 31 13:10:33.516016 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 31 13:10:33.516016 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Id: fdf85a7b31004baf848842ad2f74cbf0 Aug 31 13:10:33.516016 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-AttachVolumeNegativeTest-2039526226 Aug 31 13:10:33.516016 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Role: member,reader Aug 31 13:10:33.516016 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Roles: member,reader Aug 31 13:10:33.517509 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fdf85a7b31004baf848842ad2f74cbf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fdf85a7b31004baf848842ad2f74cbf0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fdf85a7b31004baf848842ad2f74cbf0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fdf85a7b31004baf848842ad2f74cbf0"}]}] Aug 31 13:10:33.517509 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-AttachVolumeNegativeTest-2039526226 Aug 31 13:10:33.517509 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant-Id: fdf85a7b31004baf848842ad2f74cbf0 Aug 31 13:10:33.517509 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2039526226 Aug 31 13:10:33.517509 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User: tempest-AttachVolumeNegativeTest-2039526226-project Aug 31 13:10:33.517509 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 31 13:10:33.517509 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 31 13:10:33.517509 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Id: ac2a50988be24e20be034777225d8106 Aug 31 13:10:33.517509 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-AttachVolumeNegativeTest-2039526226-project Aug 31 13:10:33.517509 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: method: > Aug 31 13:10:33.517509 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: exception: Instance ba62b7ce-5880-4281-a5a4-020d70e5b16d could not be found. Aug 31 13:10:33.517509 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: action_args: {'id': 'ba62b7ce-5880-4281-a5a4-020d70e5b16d'} Aug 31 13:10:33.518336 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:10:33.518336 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:10:33.518336 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 13:10:33.518336 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 13:10:33.518336 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 13:10:33.518336 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 13:10:33.518336 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 13:10:33.518336 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 13:10:33.518336 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 13:10:33.518336 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 13:10:33.518336 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba62b7ce-5880-4281-a5a4-020d70e5b16d could not be found. Aug 31 13:10:33.518336 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:10:33.518336 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:10:33.518336 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:10:33.518336 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:10:33.518336 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:10:33.518336 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:10:33.518336 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:10:33.518336 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:10:33.518336 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:10:33.519611 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:10:33.519611 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 13:10:33.519611 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 13:10:33.519611 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 13:10:33.519611 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 13:10:33.519611 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 13:10:33.519611 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 13:10:33.519611 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba62b7ce-5880-4281-a5a4-020d70e5b16d could not be found. Aug 31 13:10:33.519611 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:10:33.519611 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:10:33.519611 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:10:33.519611 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:10:33.519611 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:10:33.519611 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:10:33.519611 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:10:33.519611 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:10:33.519611 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba62b7ce-5880-4281-a5a4-020d70e5b16d could not be found. Aug 31 13:10:33.519611 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:10:33.520773 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-94c60dfa-774a-42c7-9b1f-11c59f7219b9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] Returning 404 to user: Instance ba62b7ce-5880-4281-a5a4-020d70e5b16d could not be found. {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:10:33.520773 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-94c60dfa-774a-42c7-9b1f-11c59f7219b9 tempest-AttachVolumeNegativeTest-2039526226 tempest-AttachVolumeNegativeTest-2039526226-project] 10.222.0.58 "GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d" status: 404 len: 111 microversion: 2.1 time: 0.031926 Aug 31 13:10:33.520773 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 436/898] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:10:33 2022] GET /compute/v2.1/servers/ba62b7ce-5880-4281-a5a4-020d70e5b16d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:12:06.509837 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_api:SELECT=11 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:12:06.511770 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=1 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:12:06.513687 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 13:12:06.513983 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Wed Aug 31 13:12:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d/os-volume_attachments/b34f3be1-56ce-4f99-b5fe-9a5747f70833 (ip 10.222.0.58) !!! Aug 31 13:12:06.522488 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-d99845b1-e815-4e79-81ed-237ab3e75e3c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:12:06.523295 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-d99845b1-e815-4e79-81ed-237ab3e75e3c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:12:06.535113 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d99845b1-e815-4e79-81ed-237ab3e75e3c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:12:06.535593 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d99845b1-e815-4e79-81ed-237ab3e75e3c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:12:06.536145 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d99845b1-e815-4e79-81ed-237ab3e75e3c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:12:06.536823 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d99845b1-e815-4e79-81ed-237ab3e75e3c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:12:06.537269 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d99845b1-e815-4e79-81ed-237ab3e75e3c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:12:06.537685 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d99845b1-e815-4e79-81ed-237ab3e75e3c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:12:06.569158 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-d99845b1-e815-4e79-81ed-237ab3e75e3c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d/os-volume_attachments/b34f3be1-56ce-4f99-b5fe-9a5747f70833" status: 200 len: 194 microversion: 2.20 time: 0.062613 Aug 31 13:12:06.569734 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 463/899] 10.222.0.58 () {60 vars in 1454 bytes} [Wed Aug 31 13:12:06 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d/os-volume_attachments/b34f3be1-56ce-4f99-b5fe-9a5747f70833 => generated 194 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:12:06.637677 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:12:06.638461 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=6 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:12:06.645132 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-f3df2b48-de7f-4bab-b2d2-60bb67ff2cb3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:12:06.645853 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-f3df2b48-de7f-4bab-b2d2-60bb67ff2cb3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:12:06.656307 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f3df2b48-de7f-4bab-b2d2-60bb67ff2cb3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:12:06.656989 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f3df2b48-de7f-4bab-b2d2-60bb67ff2cb3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:12:06.657636 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f3df2b48-de7f-4bab-b2d2-60bb67ff2cb3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:12:06.658321 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f3df2b48-de7f-4bab-b2d2-60bb67ff2cb3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:12:06.658774 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f3df2b48-de7f-4bab-b2d2-60bb67ff2cb3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:12:06.659193 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f3df2b48-de7f-4bab-b2d2-60bb67ff2cb3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:12:06.744617 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.objects.instance [None req-f3df2b48-de7f-4bab-b2d2-60bb67ff2cb3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lazy-loading 'services' on Instance uuid 21c9e3cb-e5b1-428d-8405-ec33632c5f3d {{(pid=120705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 13:12:06.817964 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-f3df2b48-de7f-4bab-b2d2-60bb67ff2cb3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "DELETE /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d/os-volume_attachments/b34f3be1-56ce-4f99-b5fe-9a5747f70833" status: 202 len: 0 microversion: 2.20 time: 0.182988 Aug 31 13:12:06.818584 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 437/900] 10.222.0.58 () {60 vars in 1457 bytes} [Wed Aug 31 13:12:06 2022] DELETE /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d/os-volume_attachments/b34f3be1-56ce-4f99-b5fe-9a5747f70833 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:12:06.827179 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-9f1eabe3-6d9f-48bb-bef7-296bcea734fa tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:12:06.829548 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-9f1eabe3-6d9f-48bb-bef7-296bcea734fa tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:12:06.836087 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9f1eabe3-6d9f-48bb-bef7-296bcea734fa tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:12:06.836625 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9f1eabe3-6d9f-48bb-bef7-296bcea734fa tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:12:06.837032 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9f1eabe3-6d9f-48bb-bef7-296bcea734fa tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:12:06.838057 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9f1eabe3-6d9f-48bb-bef7-296bcea734fa tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:12:06.838667 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9f1eabe3-6d9f-48bb-bef7-296bcea734fa tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:12:06.839266 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9f1eabe3-6d9f-48bb-bef7-296bcea734fa tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:12:06.869092 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-9f1eabe3-6d9f-48bb-bef7-296bcea734fa tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045914 Aug 31 13:12:06.869886 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 464/901] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 31 13:12:06 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:12:07.882856 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-79dda43f-c9ec-496a-8e98-a840793d7a71 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:12:07.885849 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-79dda43f-c9ec-496a-8e98-a840793d7a71 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:12:07.892232 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-79dda43f-c9ec-496a-8e98-a840793d7a71 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:12:07.892717 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-79dda43f-c9ec-496a-8e98-a840793d7a71 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:12:07.893147 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-79dda43f-c9ec-496a-8e98-a840793d7a71 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:12:07.893840 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-79dda43f-c9ec-496a-8e98-a840793d7a71 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:12:07.894287 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-79dda43f-c9ec-496a-8e98-a840793d7a71 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:12:07.894705 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-79dda43f-c9ec-496a-8e98-a840793d7a71 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:12:07.924957 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-79dda43f-c9ec-496a-8e98-a840793d7a71 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047020 Aug 31 13:12:07.925530 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 438/902] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 31 13:12:07 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:12:08.003642 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-dedd853a-8f34-4133-9e8b-f608287a2e4d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:12:08.004734 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-dedd853a-8f34-4133-9e8b-f608287a2e4d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:12:08.011583 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-dedd853a-8f34-4133-9e8b-f608287a2e4d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:12:08.011990 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-dedd853a-8f34-4133-9e8b-f608287a2e4d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:12:08.012426 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-dedd853a-8f34-4133-9e8b-f608287a2e4d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:12:08.013176 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-dedd853a-8f34-4133-9e8b-f608287a2e4d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:12:08.014216 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-dedd853a-8f34-4133-9e8b-f608287a2e4d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:12:08.014632 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-dedd853a-8f34-4133-9e8b-f608287a2e4d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:12:08.042432 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-dedd853a-8f34-4133-9e8b-f608287a2e4d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Going to try to terminate instance {{(pid=120704) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 13:12:08.123138 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-dedd853a-8f34-4133-9e8b-f608287a2e4d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "DELETE /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 204 len: 0 microversion: 2.20 time: 0.122864 Aug 31 13:12:08.126972 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 465/903] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 31 13:12:07 2022] DELETE /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 13:12:08.132749 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-09cde521-da31-433c-a33e-7ea65545dc55 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:12:08.133379 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-09cde521-da31-433c-a33e-7ea65545dc55 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:12:08.140511 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-09cde521-da31-433c-a33e-7ea65545dc55 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:12:08.140996 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-09cde521-da31-433c-a33e-7ea65545dc55 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:12:08.141459 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-09cde521-da31-433c-a33e-7ea65545dc55 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:12:08.142158 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-09cde521-da31-433c-a33e-7ea65545dc55 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:12:08.142643 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-09cde521-da31-433c-a33e-7ea65545dc55 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:12:08.143070 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-09cde521-da31-433c-a33e-7ea65545dc55 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:12:08.273540 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-09cde521-da31-433c-a33e-7ea65545dc55 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:12:08.282643 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-09cde521-da31-433c-a33e-7ea65545dc55 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:12:08.284192 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-09cde521-da31-433c-a33e-7ea65545dc55 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:12:08.285370 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-09cde521-da31-433c-a33e-7ea65545dc55 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1722 microversion: 2.20 time: 0.156979 Aug 31 13:12:08.285969 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 439/904] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:12:08 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:12:09.314444 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-7a13a015-172e-40c4-8c36-691eb1deff55 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:12:09.315438 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-7a13a015-172e-40c4-8c36-691eb1deff55 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:12:09.326369 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7a13a015-172e-40c4-8c36-691eb1deff55 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:12:09.327150 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7a13a015-172e-40c4-8c36-691eb1deff55 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:12:09.327888 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7a13a015-172e-40c4-8c36-691eb1deff55 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:12:09.329007 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7a13a015-172e-40c4-8c36-691eb1deff55 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:12:09.329762 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7a13a015-172e-40c4-8c36-691eb1deff55 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:12:09.330175 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7a13a015-172e-40c4-8c36-691eb1deff55 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:12:09.464639 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-7a13a015-172e-40c4-8c36-691eb1deff55 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:12:09.473002 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-7a13a015-172e-40c4-8c36-691eb1deff55 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:12:09.474417 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-7a13a015-172e-40c4-8c36-691eb1deff55 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:12:09.475592 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-7a13a015-172e-40c4-8c36-691eb1deff55 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1722 microversion: 2.20 time: 0.168438 Aug 31 13:12:09.476367 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 466/905] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:12:09 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:12:10.507498 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-a1a6a12b-faee-4584-94c8-363546d12588 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:12:10.508145 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-a1a6a12b-faee-4584-94c8-363546d12588 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:12:10.514874 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a1a6a12b-faee-4584-94c8-363546d12588 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:12:10.515355 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a1a6a12b-faee-4584-94c8-363546d12588 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:12:10.515779 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a1a6a12b-faee-4584-94c8-363546d12588 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:12:10.516498 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a1a6a12b-faee-4584-94c8-363546d12588 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:12:10.516935 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a1a6a12b-faee-4584-94c8-363546d12588 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:12:10.517363 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a1a6a12b-faee-4584-94c8-363546d12588 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:12:10.651939 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-a1a6a12b-faee-4584-94c8-363546d12588 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:12:10.661118 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-a1a6a12b-faee-4584-94c8-363546d12588 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:12:10.662538 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-a1a6a12b-faee-4584-94c8-363546d12588 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:12:10.663704 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-a1a6a12b-faee-4584-94c8-363546d12588 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1722 microversion: 2.20 time: 0.160489 Aug 31 13:12:10.664281 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 440/906] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:12:10 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:12:11.331631 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-668bc755-d0d8-4dc7-a9e0-fcbe473378a5 req-0b09aaf4-b250-43e6-baa0-d2e0651b8655 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21c9e3cb-e5b1-428d-8405-ec33632c5f3d", "name": "network-vif-deleted", "tag": "b32c3e63-7e7a-4bf8-bf81-80a7acf17f63"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:12:11.341662 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-668bc755-d0d8-4dc7-a9e0-fcbe473378a5 req-0b09aaf4-b250-43e6-baa0-d2e0651b8655 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:12:11.342134 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-668bc755-d0d8-4dc7-a9e0-fcbe473378a5 req-0b09aaf4-b250-43e6-baa0-d2e0651b8655 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:12:11.342566 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-668bc755-d0d8-4dc7-a9e0-fcbe473378a5 req-0b09aaf4-b250-43e6-baa0-d2e0651b8655 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:12:11.354303 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-668bc755-d0d8-4dc7-a9e0-fcbe473378a5 req-0b09aaf4-b250-43e6-baa0-d2e0651b8655 service nova] Creating event network-vif-deleted:b32c3e63-7e7a-4bf8-bf81-80a7acf17f63 for instance 21c9e3cb-e5b1-428d-8405-ec33632c5f3d on hv-cinder-85442 Aug 31 13:12:11.360143 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-668bc755-d0d8-4dc7-a9e0-fcbe473378a5 req-0b09aaf4-b250-43e6-baa0-d2e0651b8655 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032131 Aug 31 13:12:11.361210 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 467/907] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:12:11.687076 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-abd3a613-9f4f-433c-a6f6-4e7664431390 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:12:11.687784 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-abd3a613-9f4f-433c-a6f6-4e7664431390 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:12:11.695177 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-abd3a613-9f4f-433c-a6f6-4e7664431390 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:12:11.695708 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-abd3a613-9f4f-433c-a6f6-4e7664431390 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:12:11.696173 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-abd3a613-9f4f-433c-a6f6-4e7664431390 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:12:11.696865 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-abd3a613-9f4f-433c-a6f6-4e7664431390 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:12:11.697463 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-abd3a613-9f4f-433c-a6f6-4e7664431390 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:12:11.697862 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-abd3a613-9f4f-433c-a6f6-4e7664431390 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:12:11.732176 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-abd3a613-9f4f-433c-a6f6-4e7664431390 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:12:11.732664 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-abd3a613-9f4f-433c-a6f6-4e7664431390 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:12:11.733095 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-abd3a613-9f4f-433c-a6f6-4e7664431390 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:12:11.733541 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.objects.instance [None req-abd3a613-9f4f-433c-a6f6-4e7664431390 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lazy-loading 'fault' on Instance uuid 21c9e3cb-e5b1-428d-8405-ec33632c5f3d {{(pid=120705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 13:12:11.773990 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-abd3a613-9f4f-433c-a6f6-4e7664431390 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:12:11.783685 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-abd3a613-9f4f-433c-a6f6-4e7664431390 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:12:11.785929 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-abd3a613-9f4f-433c-a6f6-4e7664431390 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:12:11.787323 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-abd3a613-9f4f-433c-a6f6-4e7664431390 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 200 len: 1371 microversion: 2.20 time: 0.104420 Aug 31 13:12:11.787933 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 441/908] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:12:11 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 1371 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:12:12.816133 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-bb689205-59c5-4685-8eb1-153334ce869f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:12:12.816788 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-bb689205-59c5-4685-8eb1-153334ce869f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:12:12.823529 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bb689205-59c5-4685-8eb1-153334ce869f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:12:12.824046 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bb689205-59c5-4685-8eb1-153334ce869f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:12:12.824486 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bb689205-59c5-4685-8eb1-153334ce869f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:12:12.825214 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bb689205-59c5-4685-8eb1-153334ce869f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:12:12.825670 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bb689205-59c5-4685-8eb1-153334ce869f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:12:12.826077 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bb689205-59c5-4685-8eb1-153334ce869f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:12:12.841995 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.wsgi [None req-bb689205-59c5-4685-8eb1-153334ce869f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] HTTP exception thrown: Instance 21c9e3cb-e5b1-428d-8405-ec33632c5f3d could not be found. Aug 31 13:12:12.843641 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-bb689205-59c5-4685-8eb1-153334ce869f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Request method failure captured: Aug 31 13:12:12.843641 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: request: GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d HTTP/1.1 Aug 31 13:12:12.843641 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept: application/json Aug 31 13:12:12.843641 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept-Encoding: identity Aug 31 13:12:12.843641 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Connection: close Aug 31 13:12:12.843641 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Length: 0 Aug 31 13:12:12.843641 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Type: application/json Aug 31 13:12:12.843641 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Host: 10.222.0.58 Aug 31 13:12:12.843641 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Openstack-System-Scope: None Aug 31 13:12:12.843641 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: User-Agent: python-urllib3/1.26.12 Aug 31 13:12:12.843641 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Auth-Token: gAAAAABjD10V1pDy8vLsqU7eN4fBfkHumRYncrASgxbQHDwed3X-qzRV4BOn7bS7unBc59JyrqzfyOD42czlJn_CS32tzMZE6Eh9BfiiBTBwp_THEAnwuUBDSc2IU0zCJArqiQPh1wS5An3C9vT4PAKjtvZTjsWe0BQIj0MiiPhoEoxdaruYlcU Aug 31 13:12:12.843641 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Id: None Aug 31 13:12:12.843641 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Name: None Aug 31 13:12:12.843641 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Identity-Status: Confirmed Aug 31 13:12:12.843641 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Is-Admin-Project: True Aug 31 13:12:12.843641 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 13:12:12.843641 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Id: default Aug 31 13:12:12.843641 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Name: Default Aug 31 13:12:12.843641 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Id: 8ed24957ab734181bca8793a33f63645 Aug 31 13:12:12.843641 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1938781708 Aug 31 13:12:12.843641 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Role: member,reader Aug 31 13:12:12.843641 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Roles: member,reader Aug 31 13:12:12.845422 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8ed24957ab734181bca8793a33f63645"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8ed24957ab734181bca8793a33f63645"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8ed24957ab734181bca8793a33f63645"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8ed24957ab734181bca8793a33f63645"}]}] Aug 31 13:12:12.845422 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1938781708 Aug 31 13:12:12.845422 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Id: 8ed24957ab734181bca8793a33f63645 Aug 31 13:12:12.845422 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1938781708 Aug 31 13:12:12.845422 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User: tempest-AttachVolumeShelveTestJSON-1938781708-project Aug 31 13:12:12.845422 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Id: default Aug 31 13:12:12.845422 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Name: Default Aug 31 13:12:12.845422 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Id: fb16ef11b3a9482ab5d40ff98ebd9cae Aug 31 13:12:12.845422 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1938781708-project Aug 31 13:12:12.845422 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: method: > Aug 31 13:12:12.845422 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: exception: Instance 21c9e3cb-e5b1-428d-8405-ec33632c5f3d could not be found. Aug 31 13:12:12.845422 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: action_args: {'id': '21c9e3cb-e5b1-428d-8405-ec33632c5f3d'} Aug 31 13:12:12.846353 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:12:12.846353 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:12:12.846353 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 13:12:12.846353 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 13:12:12.846353 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 13:12:12.846353 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 13:12:12.846353 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 13:12:12.846353 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 13:12:12.846353 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 13:12:12.846353 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 13:12:12.846353 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21c9e3cb-e5b1-428d-8405-ec33632c5f3d could not be found. Aug 31 13:12:12.846353 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:12:12.846353 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:12:12.846353 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:12:12.846353 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:12:12.846353 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:12:12.846353 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:12:12.846353 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:12:12.846353 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:12:12.846353 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:12:12.848125 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:12:12.848125 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 13:12:12.848125 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 13:12:12.848125 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 13:12:12.848125 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 13:12:12.848125 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 13:12:12.848125 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 13:12:12.848125 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21c9e3cb-e5b1-428d-8405-ec33632c5f3d could not be found. Aug 31 13:12:12.848125 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:12:12.848125 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:12:12.848125 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:12:12.848125 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:12:12.848125 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:12:12.848125 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:12:12.848125 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:12:12.848125 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:12:12.848125 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21c9e3cb-e5b1-428d-8405-ec33632c5f3d could not be found. Aug 31 13:12:12.848125 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:12:12.849555 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-bb689205-59c5-4685-8eb1-153334ce869f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Returning 404 to user: Instance 21c9e3cb-e5b1-428d-8405-ec33632c5f3d could not be found. {{(pid=120704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:12:12.849555 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-bb689205-59c5-4685-8eb1-153334ce869f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 404 len: 111 microversion: 2.20 time: 0.037122 Aug 31 13:12:12.849555 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 468/909] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:12:12 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 13:12:12.854370 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-d1437ad5-b9cc-47a6-9a3a-40c5347fdada tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '.version_select at 0x7f1954c20310>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:12:12.876631 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-d1437ad5-b9cc-47a6-9a3a-40c5347fdada tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-809607317" status: 204 len: 0 microversion: 2.20 time: 0.026165 Aug 31 13:12:12.877188 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 442/910] 10.222.0.58 () {60 vars in 1259 bytes} [Wed Aug 31 13:12:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-809607317 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 13:12:13.518941 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-a13c62f8-58cd-426f-a185-26ff254c1d88 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Action: 'create', calling method: .version_select at 0x7f195115db80>, body: {"keypair": {"name": "tempest-keypair-1271131285", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1S5fnVpfufF1YvGXP1xWOKZpzynaxjE/mFITI2gR0c1J/mEgRMrdmAfc6+MaC1XS4CZpSiV8BKtkc50VA3oYA43Ml62t4vBc35lIz4EyFxCUksl0UDYabqUjXg1C5Ujg=="}} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:12:13.534569 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.quota [None req-a13c62f8-58cd-426f-a185-26ff254c1d88 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Getting quotas for project 8ed24957ab734181bca8793a33f63645. Resources: {'key_pairs'} {{(pid=120704) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 13:12:13.538413 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.quota [None req-a13c62f8-58cd-426f-a185-26ff254c1d88 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Getting quotas for user fb16ef11b3a9482ab5d40ff98ebd9cae and project 8ed24957ab734181bca8793a33f63645. Resources: {'key_pairs'} {{(pid=120704) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 13:12:13.564377 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-a13c62f8-58cd-426f-a185-26ff254c1d88 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.049548 Aug 31 13:12:13.564993 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 469/911] 10.222.0.58 () {62 vars in 1200 bytes} [Wed Aug 31 13:12:13 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 13:12:14.897305 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-0bca3742-b4ff-44f5-8c96-962ab55ec34d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1867271261", "imageRef": "2aa55919-0f25-4e84-a2e1-f60acbe208b2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cfa73093-1e0e-4a6a-8e10-98c16a5ac11f"}], "security_groups": [{"name": "tempest-securitygroup--1592799060"}], "key_name": "tempest-keypair-1271131285", "user_data": "}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:12:15.002250 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.network.neutron [None req-0bca3742-b4ff-44f5-8c96-962ab55ec34d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] validate_networks() for [('cfa73093-1e0e-4a6a-8e10-98c16a5ac11f', None, None, None, None, None)] {{(pid=120705) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 13:12:15.516002 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-0bca3742-b4ff-44f5-8c96-962ab55ec34d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Flavor limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 13:12:15.516416 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-0bca3742-b4ff-44f5-8c96-962ab55ec34d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Image limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 13:12:15.516878 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-0bca3742-b4ff-44f5-8c96-962ab55ec34d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Flavor pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 13:12:15.517273 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-0bca3742-b4ff-44f5-8c96-962ab55ec34d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Image pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 13:12:15.517670 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-0bca3742-b4ff-44f5-8c96-962ab55ec34d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 13:12:15.526690 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0bca3742-b4ff-44f5-8c96-962ab55ec34d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:12:15.527164 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0bca3742-b4ff-44f5-8c96-962ab55ec34d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:12:15.527591 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0bca3742-b4ff-44f5-8c96-962ab55ec34d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:12:15.528337 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0bca3742-b4ff-44f5-8c96-962ab55ec34d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:12:15.528805 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0bca3742-b4ff-44f5-8c96-962ab55ec34d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:12:15.529215 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0bca3742-b4ff-44f5-8c96-962ab55ec34d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:12:15.547013 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-0bca3742-b4ff-44f5-8c96-962ab55ec34d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Getting quotas for project 8ed24957ab734181bca8793a33f63645. Resources: {'instances', 'ram', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 13:12:15.551475 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-0bca3742-b4ff-44f5-8c96-962ab55ec34d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Getting quotas for user fb16ef11b3a9482ab5d40ff98ebd9cae and project 8ed24957ab734181bca8793a33f63645. Resources: {'instances', 'ram', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 13:12:15.563360 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-0bca3742-b4ff-44f5-8c96-962ab55ec34d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Going to run 1 instances... {{(pid=120705) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 13:12:15.565786 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-0bca3742-b4ff-44f5-8c96-962ab55ec34d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2aa55919-0f25-4e84-a2e1-f60acbe208b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120705) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 13:12:15.611217 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0bca3742-b4ff-44f5-8c96-962ab55ec34d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [3f489960-c6eb-4532-95cb-6213611be01d] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 13:12:16.624672 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO oslo.messaging._drivers.impl_rabbit [None req-0bca3742-b4ff-44f5-8c96-962ab55ec34d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [3f489960-c6eb-4532-95cb-6213611be01d] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 45068. Aug 31 13:12:16.630463 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-0bca3742-b4ff-44f5-8c96-962ab55ec34d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.739194 Aug 31 13:12:16.631322 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 443/912] 10.222.0.58 () {62 vars in 1188 bytes} [Wed Aug 31 13:12:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 1741 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 13:12:16.642961 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-547d8c77-bb29-40cf-a8ed-323e327767dc tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:12:16.643559 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-547d8c77-bb29-40cf-a8ed-323e327767dc tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:12:16.700718 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-547d8c77-bb29-40cf-a8ed-323e327767dc tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:12:16.708394 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-547d8c77-bb29-40cf-a8ed-323e327767dc tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:12:16.709840 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-547d8c77-bb29-40cf-a8ed-323e327767dc tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:12:16.710980 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-547d8c77-bb29-40cf-a8ed-323e327767dc tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1282 microversion: 2.20 time: 0.072629 Aug 31 13:12:16.711538 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 470/913] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:12:16 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1282 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:12:17.734796 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-c8257c42-07fe-43f2-bb47-25b527db154d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:12:17.735399 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-c8257c42-07fe-43f2-bb47-25b527db154d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:12:17.742704 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c8257c42-07fe-43f2-bb47-25b527db154d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:12:17.743191 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c8257c42-07fe-43f2-bb47-25b527db154d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:12:17.743636 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c8257c42-07fe-43f2-bb47-25b527db154d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:12:17.744350 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c8257c42-07fe-43f2-bb47-25b527db154d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:12:17.744980 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c8257c42-07fe-43f2-bb47-25b527db154d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:12:17.745406 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c8257c42-07fe-43f2-bb47-25b527db154d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:12:17.810413 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-c8257c42-07fe-43f2-bb47-25b527db154d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:12:17.819437 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-c8257c42-07fe-43f2-bb47-25b527db154d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:12:17.820995 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-c8257c42-07fe-43f2-bb47-25b527db154d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:12:17.822115 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-c8257c42-07fe-43f2-bb47-25b527db154d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1342 microversion: 2.20 time: 0.091951 Aug 31 13:12:17.822714 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 444/914] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:12:17 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1342 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:12:18.849384 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-8174a6f9-0918-4712-955c-22695d16171b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:12:18.850011 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-8174a6f9-0918-4712-955c-22695d16171b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:12:18.857509 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8174a6f9-0918-4712-955c-22695d16171b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:12:18.857986 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8174a6f9-0918-4712-955c-22695d16171b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:12:18.858461 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8174a6f9-0918-4712-955c-22695d16171b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:12:18.859178 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8174a6f9-0918-4712-955c-22695d16171b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:12:18.859647 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8174a6f9-0918-4712-955c-22695d16171b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:12:18.860209 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8174a6f9-0918-4712-955c-22695d16171b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:12:19.004515 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-8174a6f9-0918-4712-955c-22695d16171b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:12:19.012932 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-8174a6f9-0918-4712-955c-22695d16171b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:12:19.014375 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-8174a6f9-0918-4712-955c-22695d16171b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:12:19.015498 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-8174a6f9-0918-4712-955c-22695d16171b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1408 microversion: 2.20 time: 0.170801 Aug 31 13:12:19.016106 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 471/915] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:12:18 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:12:19.200570 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-1276925f-47ea-4634-ba3d-f20e3f60a6d6 req-6267b70f-02f1-4441-9ce9-2ac412fc07d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b02d1346-91cf-4003-a5f4-8ae3e32d6e75", "tag": "51d49abf-a001-4e75-bc6f-08a55177cf60"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:12:19.212812 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-1276925f-47ea-4634-ba3d-f20e3f60a6d6 req-6267b70f-02f1-4441-9ce9-2ac412fc07d9 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:12:19.213423 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-1276925f-47ea-4634-ba3d-f20e3f60a6d6 req-6267b70f-02f1-4441-9ce9-2ac412fc07d9 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:12:19.213952 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-1276925f-47ea-4634-ba3d-f20e3f60a6d6 req-6267b70f-02f1-4441-9ce9-2ac412fc07d9 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:12:19.225339 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-1276925f-47ea-4634-ba3d-f20e3f60a6d6 req-6267b70f-02f1-4441-9ce9-2ac412fc07d9 service nova] Creating event network-changed:51d49abf-a001-4e75-bc6f-08a55177cf60 for instance b02d1346-91cf-4003-a5f4-8ae3e32d6e75 on hv-cinder-85442 Aug 31 13:12:19.230498 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-1276925f-47ea-4634-ba3d-f20e3f60a6d6 req-6267b70f-02f1-4441-9ce9-2ac412fc07d9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033946 Aug 31 13:12:19.231085 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 445/916] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:12:20.040680 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-9a58194b-afda-4a55-9761-877d510ec145 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:12:20.041518 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-9a58194b-afda-4a55-9761-877d510ec145 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:12:20.050626 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9a58194b-afda-4a55-9761-877d510ec145 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:12:20.051108 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9a58194b-afda-4a55-9761-877d510ec145 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:12:20.051547 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9a58194b-afda-4a55-9761-877d510ec145 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:12:20.052289 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9a58194b-afda-4a55-9761-877d510ec145 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:12:20.052734 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9a58194b-afda-4a55-9761-877d510ec145 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:12:20.053160 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9a58194b-afda-4a55-9761-877d510ec145 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:12:20.184324 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-9a58194b-afda-4a55-9761-877d510ec145 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:12:20.193220 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-9a58194b-afda-4a55-9761-877d510ec145 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:12:20.194636 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-9a58194b-afda-4a55-9761-877d510ec145 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:12:20.195743 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-9a58194b-afda-4a55-9761-877d510ec145 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1408 microversion: 2.20 time: 0.160421 Aug 31 13:12:20.196320 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 472/917] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:12:20 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:12:21.227614 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-6c2745af-f9ef-4694-8bbd-75ac790be89e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:12:21.228684 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-6c2745af-f9ef-4694-8bbd-75ac790be89e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:12:21.239386 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6c2745af-f9ef-4694-8bbd-75ac790be89e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:12:21.240224 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6c2745af-f9ef-4694-8bbd-75ac790be89e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:12:21.240951 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6c2745af-f9ef-4694-8bbd-75ac790be89e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:12:21.242087 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6c2745af-f9ef-4694-8bbd-75ac790be89e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:12:21.242839 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6c2745af-f9ef-4694-8bbd-75ac790be89e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:12:21.243545 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6c2745af-f9ef-4694-8bbd-75ac790be89e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:12:21.385371 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-6c2745af-f9ef-4694-8bbd-75ac790be89e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:12:21.393680 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-6c2745af-f9ef-4694-8bbd-75ac790be89e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:12:21.395122 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-6c2745af-f9ef-4694-8bbd-75ac790be89e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:12:21.396268 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-6c2745af-f9ef-4694-8bbd-75ac790be89e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1408 microversion: 2.20 time: 0.176890 Aug 31 13:12:21.396831 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 446/918] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:12:21 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1408 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:12:22.423628 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-c5071233-7d12-4b4f-80bc-c50174b58737 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:12:22.424609 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-c5071233-7d12-4b4f-80bc-c50174b58737 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:12:22.431652 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c5071233-7d12-4b4f-80bc-c50174b58737 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:12:22.432161 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c5071233-7d12-4b4f-80bc-c50174b58737 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:12:22.432589 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c5071233-7d12-4b4f-80bc-c50174b58737 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:12:22.433278 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c5071233-7d12-4b4f-80bc-c50174b58737 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:12:22.433721 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c5071233-7d12-4b4f-80bc-c50174b58737 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:12:22.434139 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c5071233-7d12-4b4f-80bc-c50174b58737 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:12:22.571386 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-c5071233-7d12-4b4f-80bc-c50174b58737 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:12:22.579846 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-c5071233-7d12-4b4f-80bc-c50174b58737 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:12:22.581360 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-c5071233-7d12-4b4f-80bc-c50174b58737 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:12:22.582469 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-c5071233-7d12-4b4f-80bc-c50174b58737 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1408 microversion: 2.20 time: 0.165574 Aug 31 13:12:22.583043 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 473/919] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:12:22 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1408 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:12:23.604657 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-9d377787-c815-412e-af2c-aa4431146114 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:12:23.605242 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-9d377787-c815-412e-af2c-aa4431146114 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:12:23.612145 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9d377787-c815-412e-af2c-aa4431146114 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:12:23.612644 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9d377787-c815-412e-af2c-aa4431146114 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:12:23.613076 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9d377787-c815-412e-af2c-aa4431146114 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:12:23.613807 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9d377787-c815-412e-af2c-aa4431146114 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:12:23.614247 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9d377787-c815-412e-af2c-aa4431146114 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:12:23.614667 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9d377787-c815-412e-af2c-aa4431146114 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:12:23.751884 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-9d377787-c815-412e-af2c-aa4431146114 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:12:23.764610 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-9d377787-c815-412e-af2c-aa4431146114 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:12:23.766880 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-9d377787-c815-412e-af2c-aa4431146114 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:12:23.768651 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-9d377787-c815-412e-af2c-aa4431146114 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1408 microversion: 2.20 time: 0.167963 Aug 31 13:12:23.769292 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 447/920] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:12:23 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:12:24.798727 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-63fd7dc0-01e3-497f-9fcc-bf8862a3e462 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:12:24.799315 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-63fd7dc0-01e3-497f-9fcc-bf8862a3e462 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:12:24.806511 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-63fd7dc0-01e3-497f-9fcc-bf8862a3e462 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:12:24.807030 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-63fd7dc0-01e3-497f-9fcc-bf8862a3e462 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:12:24.807487 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-63fd7dc0-01e3-497f-9fcc-bf8862a3e462 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:12:24.808223 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-63fd7dc0-01e3-497f-9fcc-bf8862a3e462 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:12:24.808641 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-63fd7dc0-01e3-497f-9fcc-bf8862a3e462 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:12:24.809081 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-63fd7dc0-01e3-497f-9fcc-bf8862a3e462 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:12:24.942872 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-63fd7dc0-01e3-497f-9fcc-bf8862a3e462 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:12:24.951462 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-63fd7dc0-01e3-497f-9fcc-bf8862a3e462 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:12:24.952934 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-63fd7dc0-01e3-497f-9fcc-bf8862a3e462 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:12:24.954121 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-63fd7dc0-01e3-497f-9fcc-bf8862a3e462 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1408 microversion: 2.20 time: 0.159405 Aug 31 13:12:24.955844 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 474/921] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:12:24 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:12:24.978673 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-bb3253e2-4dee-406d-bd5a-7d190f3a3099 req-da47aa37-e7dc-4fe5-ab52-3fd28b327abe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b02d1346-91cf-4003-a5f4-8ae3e32d6e75", "name": "network-vif-plugged", "status": "completed", "tag": "51d49abf-a001-4e75-bc6f-08a55177cf60"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:12:24.988102 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-bb3253e2-4dee-406d-bd5a-7d190f3a3099 req-da47aa37-e7dc-4fe5-ab52-3fd28b327abe service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:12:24.988575 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-bb3253e2-4dee-406d-bd5a-7d190f3a3099 req-da47aa37-e7dc-4fe5-ab52-3fd28b327abe service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:12:24.989002 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-bb3253e2-4dee-406d-bd5a-7d190f3a3099 req-da47aa37-e7dc-4fe5-ab52-3fd28b327abe service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:12:25.000193 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-bb3253e2-4dee-406d-bd5a-7d190f3a3099 req-da47aa37-e7dc-4fe5-ab52-3fd28b327abe service nova] Creating event network-vif-plugged:51d49abf-a001-4e75-bc6f-08a55177cf60 for instance b02d1346-91cf-4003-a5f4-8ae3e32d6e75 on hv-cinder-85442 Aug 31 13:12:25.005662 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-bb3253e2-4dee-406d-bd5a-7d190f3a3099 req-da47aa37-e7dc-4fe5-ab52-3fd28b327abe service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170161 Aug 31 13:12:25.006253 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 448/922] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:12:25.976516 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-dbabc7bc-2e44-4384-9b32-551380fae3cb tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:12:25.977120 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-dbabc7bc-2e44-4384-9b32-551380fae3cb tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:12:25.984029 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-dbabc7bc-2e44-4384-9b32-551380fae3cb tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:12:25.984510 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-dbabc7bc-2e44-4384-9b32-551380fae3cb tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:12:25.984955 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-dbabc7bc-2e44-4384-9b32-551380fae3cb tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:12:25.985635 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-dbabc7bc-2e44-4384-9b32-551380fae3cb tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:12:25.986115 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-dbabc7bc-2e44-4384-9b32-551380fae3cb tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:12:25.986534 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-dbabc7bc-2e44-4384-9b32-551380fae3cb tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:12:26.128079 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-dbabc7bc-2e44-4384-9b32-551380fae3cb tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:12:26.136806 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-dbabc7bc-2e44-4384-9b32-551380fae3cb tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:12:26.138247 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-dbabc7bc-2e44-4384-9b32-551380fae3cb tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:12:26.139364 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-dbabc7bc-2e44-4384-9b32-551380fae3cb tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1408 microversion: 2.20 time: 0.166933 Aug 31 13:12:26.139947 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 475/923] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:12:25 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:12:27.170246 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=2 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:12:27.171335 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=6 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:12:27.178153 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-a0bf5923-1950-4729-9743-cc6b823b60d0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:12:27.179200 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-a0bf5923-1950-4729-9743-cc6b823b60d0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:12:27.189913 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a0bf5923-1950-4729-9743-cc6b823b60d0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:12:27.190737 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a0bf5923-1950-4729-9743-cc6b823b60d0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:12:27.191176 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a0bf5923-1950-4729-9743-cc6b823b60d0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:12:27.191865 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a0bf5923-1950-4729-9743-cc6b823b60d0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:12:27.192320 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a0bf5923-1950-4729-9743-cc6b823b60d0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:12:27.192721 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a0bf5923-1950-4729-9743-cc6b823b60d0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:12:27.337758 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-a0bf5923-1950-4729-9743-cc6b823b60d0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:12:27.346313 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-a0bf5923-1950-4729-9743-cc6b823b60d0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:12:27.347869 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-a0bf5923-1950-4729-9743-cc6b823b60d0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:12:27.349045 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-a0bf5923-1950-4729-9743-cc6b823b60d0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1600 microversion: 2.20 time: 0.180593 Aug 31 13:12:27.349612 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 449/924] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:12:27 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1600 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:12:27.374298 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-1955c51e-51d2-4c28-9b5c-b6432546ec6a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:12:27.374776 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-1955c51e-51d2-4c28-9b5c-b6432546ec6a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:12:27.377942 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell0:SELECT=6 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:12:27.385963 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1955c51e-51d2-4c28-9b5c-b6432546ec6a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:12:27.386609 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1955c51e-51d2-4c28-9b5c-b6432546ec6a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:12:27.387231 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1955c51e-51d2-4c28-9b5c-b6432546ec6a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:12:27.388263 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1955c51e-51d2-4c28-9b5c-b6432546ec6a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:12:27.388954 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1955c51e-51d2-4c28-9b5c-b6432546ec6a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:12:27.389505 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1955c51e-51d2-4c28-9b5c-b6432546ec6a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:12:27.472601 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-1955c51e-51d2-4c28-9b5c-b6432546ec6a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.104266 Aug 31 13:12:27.473441 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 476/925] 10.222.0.58 () {60 vars in 1316 bytes} [Wed Aug 31 13:12:27 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:12:28.486465 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-18477fbe-1902-46f3-bf44-f0d48dabb869 req-97e3493d-bea3-489d-aa98-6065cdc82909 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b02d1346-91cf-4003-a5f4-8ae3e32d6e75", "tag": "51d49abf-a001-4e75-bc6f-08a55177cf60"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:12:28.496164 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-18477fbe-1902-46f3-bf44-f0d48dabb869 req-97e3493d-bea3-489d-aa98-6065cdc82909 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:12:28.496635 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-18477fbe-1902-46f3-bf44-f0d48dabb869 req-97e3493d-bea3-489d-aa98-6065cdc82909 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:12:28.497111 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-18477fbe-1902-46f3-bf44-f0d48dabb869 req-97e3493d-bea3-489d-aa98-6065cdc82909 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:12:28.512503 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-18477fbe-1902-46f3-bf44-f0d48dabb869 req-97e3493d-bea3-489d-aa98-6065cdc82909 service nova] Creating event network-changed:51d49abf-a001-4e75-bc6f-08a55177cf60 for instance b02d1346-91cf-4003-a5f4-8ae3e32d6e75 on hv-cinder-85442 Aug 31 13:12:28.517766 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-18477fbe-1902-46f3-bf44-f0d48dabb869 req-97e3493d-bea3-489d-aa98-6065cdc82909 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095207 Aug 31 13:12:28.518954 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 450/926] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:13:43.434578 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:13:43.435337 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:13:43.493380 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-d221a510-0427-415c-96e8-26727aa45e2a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:13:43.493875 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-d221a510-0427-415c-96e8-26727aa45e2a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:13:43.500018 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d221a510-0427-415c-96e8-26727aa45e2a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:13:43.500499 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d221a510-0427-415c-96e8-26727aa45e2a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:13:43.500932 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d221a510-0427-415c-96e8-26727aa45e2a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:13:43.501620 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d221a510-0427-415c-96e8-26727aa45e2a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:13:43.502066 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d221a510-0427-415c-96e8-26727aa45e2a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:13:43.502486 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d221a510-0427-415c-96e8-26727aa45e2a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:13:43.527852 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-d221a510-0427-415c-96e8-26727aa45e2a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75/ips" status: 200 len: 152 microversion: 2.20 time: 0.095412 Aug 31 13:13:43.528513 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 477/927] 10.222.0.58 () {60 vars in 1289 bytes} [Wed Aug 31 13:13:43 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75/ips => generated 152 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:13:45.332515 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:13:45.333707 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=67,nova_cell1:INSERT=1 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:13:45.340623 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-d5c8ec45-c1d3-4511-9aea-430dacb9cc95 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:13:45.341632 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-d5c8ec45-c1d3-4511-9aea-430dacb9cc95 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:13:45.353095 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d5c8ec45-c1d3-4511-9aea-430dacb9cc95 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:13:45.353569 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d5c8ec45-c1d3-4511-9aea-430dacb9cc95 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:13:45.353995 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d5c8ec45-c1d3-4511-9aea-430dacb9cc95 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:13:45.354679 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d5c8ec45-c1d3-4511-9aea-430dacb9cc95 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:13:45.355127 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d5c8ec45-c1d3-4511-9aea-430dacb9cc95 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:13:45.355549 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d5c8ec45-c1d3-4511-9aea-430dacb9cc95 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:13:45.379715 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.objects.instance [None req-d5c8ec45-c1d3-4511-9aea-430dacb9cc95 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lazy-loading 'flavor' on Instance uuid b02d1346-91cf-4003-a5f4-8ae3e32d6e75 {{(pid=120705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 13:13:45.564640 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-d5c8ec45-c1d3-4511-9aea-430dacb9cc95 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "POST /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75/action" status: 202 len: 0 microversion: 2.20 time: 0.235291 Aug 31 13:13:45.565235 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 451/928] 10.222.0.58 () {62 vars in 1319 bytes} [Wed Aug 31 13:13:45 2022] POST /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:13:45.574546 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-12bde114-feb6-46c9-af12-e91692184c9f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:13:45.575114 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-12bde114-feb6-46c9-af12-e91692184c9f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:13:45.582114 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-12bde114-feb6-46c9-af12-e91692184c9f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:13:45.582692 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-12bde114-feb6-46c9-af12-e91692184c9f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:13:45.583099 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-12bde114-feb6-46c9-af12-e91692184c9f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:13:45.583901 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-12bde114-feb6-46c9-af12-e91692184c9f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:13:45.584413 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-12bde114-feb6-46c9-af12-e91692184c9f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:13:45.584840 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-12bde114-feb6-46c9-af12-e91692184c9f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:13:45.719840 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-12bde114-feb6-46c9-af12-e91692184c9f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:13:45.728141 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-12bde114-feb6-46c9-af12-e91692184c9f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:13:45.729585 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-12bde114-feb6-46c9-af12-e91692184c9f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:13:45.730754 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-12bde114-feb6-46c9-af12-e91692184c9f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1725 microversion: 2.20 time: 0.160996 Aug 31 13:13:45.731325 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 478/929] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:13:45 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:13:46.761377 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b55d8be7-f4ef-4741-a003-eb0ad51b1b1e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:13:46.762527 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b55d8be7-f4ef-4741-a003-eb0ad51b1b1e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:13:46.774166 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b55d8be7-f4ef-4741-a003-eb0ad51b1b1e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:13:46.774636 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b55d8be7-f4ef-4741-a003-eb0ad51b1b1e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:13:46.775064 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b55d8be7-f4ef-4741-a003-eb0ad51b1b1e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:13:46.775737 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b55d8be7-f4ef-4741-a003-eb0ad51b1b1e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:13:46.776213 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b55d8be7-f4ef-4741-a003-eb0ad51b1b1e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:13:46.776628 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b55d8be7-f4ef-4741-a003-eb0ad51b1b1e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:13:46.914104 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-b55d8be7-f4ef-4741-a003-eb0ad51b1b1e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:13:46.922579 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-b55d8be7-f4ef-4741-a003-eb0ad51b1b1e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:13:46.924071 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-b55d8be7-f4ef-4741-a003-eb0ad51b1b1e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:13:46.925231 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b55d8be7-f4ef-4741-a003-eb0ad51b1b1e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1725 microversion: 2.20 time: 0.173321 Aug 31 13:13:46.925787 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 452/930] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:13:46 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:13:47.948232 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-4a6dd935-984a-467e-b0d2-75c0967e6d63 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:13:47.948838 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-4a6dd935-984a-467e-b0d2-75c0967e6d63 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:13:47.951137 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 13:13:47.951300 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Wed Aug 31 13:13:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 (ip 10.222.0.58) !!! Aug 31 13:13:47.958329 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4a6dd935-984a-467e-b0d2-75c0967e6d63 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:13:47.958811 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4a6dd935-984a-467e-b0d2-75c0967e6d63 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:13:47.959240 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4a6dd935-984a-467e-b0d2-75c0967e6d63 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:13:47.959975 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4a6dd935-984a-467e-b0d2-75c0967e6d63 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:13:47.960472 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4a6dd935-984a-467e-b0d2-75c0967e6d63 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:13:47.960884 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4a6dd935-984a-467e-b0d2-75c0967e6d63 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:13:48.090491 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-4a6dd935-984a-467e-b0d2-75c0967e6d63 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:13:48.098777 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-4a6dd935-984a-467e-b0d2-75c0967e6d63 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:13:48.100251 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-4a6dd935-984a-467e-b0d2-75c0967e6d63 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:13:48.101419 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-4a6dd935-984a-467e-b0d2-75c0967e6d63 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1725 microversion: 2.20 time: 0.157295 Aug 31 13:13:48.101980 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 479/931] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:13:47 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:13:49.124488 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-679d3f5e-0b41-41b9-a791-901a8bc5b5c0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:13:49.125085 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-679d3f5e-0b41-41b9-a791-901a8bc5b5c0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:13:49.132282 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-679d3f5e-0b41-41b9-a791-901a8bc5b5c0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:13:49.132712 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-679d3f5e-0b41-41b9-a791-901a8bc5b5c0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:13:49.133143 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-679d3f5e-0b41-41b9-a791-901a8bc5b5c0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:13:49.133822 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-679d3f5e-0b41-41b9-a791-901a8bc5b5c0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:13:49.134267 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-679d3f5e-0b41-41b9-a791-901a8bc5b5c0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:13:49.134684 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-679d3f5e-0b41-41b9-a791-901a8bc5b5c0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:13:49.282971 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-679d3f5e-0b41-41b9-a791-901a8bc5b5c0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:13:49.293430 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-679d3f5e-0b41-41b9-a791-901a8bc5b5c0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:13:49.294866 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-679d3f5e-0b41-41b9-a791-901a8bc5b5c0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:13:49.296052 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-679d3f5e-0b41-41b9-a791-901a8bc5b5c0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1725 microversion: 2.20 time: 0.175637 Aug 31 13:13:49.296643 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 453/932] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:13:49 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:13:50.332751 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-ecd6c54c-87cf-4506-b189-b5e66a4f253c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:13:50.333606 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-ecd6c54c-87cf-4506-b189-b5e66a4f253c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:13:50.341313 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ecd6c54c-87cf-4506-b189-b5e66a4f253c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:13:50.341790 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ecd6c54c-87cf-4506-b189-b5e66a4f253c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:13:50.342219 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ecd6c54c-87cf-4506-b189-b5e66a4f253c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:13:50.342906 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ecd6c54c-87cf-4506-b189-b5e66a4f253c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:13:50.343352 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ecd6c54c-87cf-4506-b189-b5e66a4f253c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:13:50.343771 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ecd6c54c-87cf-4506-b189-b5e66a4f253c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:13:50.487030 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-ecd6c54c-87cf-4506-b189-b5e66a4f253c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:13:50.497408 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-ecd6c54c-87cf-4506-b189-b5e66a4f253c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:13:50.498974 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-ecd6c54c-87cf-4506-b189-b5e66a4f253c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:13:50.500195 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-ecd6c54c-87cf-4506-b189-b5e66a4f253c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1725 microversion: 2.20 time: 0.174245 Aug 31 13:13:50.500768 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 480/933] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:13:50 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:13:51.528202 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-275fb4d0-48aa-4f8f-b415-3e7f994974ab tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:13:51.529207 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-275fb4d0-48aa-4f8f-b415-3e7f994974ab tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:13:51.539748 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-275fb4d0-48aa-4f8f-b415-3e7f994974ab tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:13:51.540265 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-275fb4d0-48aa-4f8f-b415-3e7f994974ab tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:13:51.540697 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-275fb4d0-48aa-4f8f-b415-3e7f994974ab tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:13:51.541387 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-275fb4d0-48aa-4f8f-b415-3e7f994974ab tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:13:51.541841 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-275fb4d0-48aa-4f8f-b415-3e7f994974ab tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:13:51.542263 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-275fb4d0-48aa-4f8f-b415-3e7f994974ab tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:13:51.678232 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-275fb4d0-48aa-4f8f-b415-3e7f994974ab tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:13:51.686591 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-275fb4d0-48aa-4f8f-b415-3e7f994974ab tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:13:51.688125 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-275fb4d0-48aa-4f8f-b415-3e7f994974ab tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:13:51.689285 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-275fb4d0-48aa-4f8f-b415-3e7f994974ab tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1725 microversion: 2.20 time: 0.167698 Aug 31 13:13:51.689849 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 454/934] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:13:51 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:13:52.713998 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-de4fe273-768d-4dd6-aee5-6894900decc3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:13:52.714692 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-de4fe273-768d-4dd6-aee5-6894900decc3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:13:52.722673 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-de4fe273-768d-4dd6-aee5-6894900decc3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:13:52.723261 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-de4fe273-768d-4dd6-aee5-6894900decc3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:13:52.723771 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-de4fe273-768d-4dd6-aee5-6894900decc3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:13:52.724617 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-de4fe273-768d-4dd6-aee5-6894900decc3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:13:52.725140 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-de4fe273-768d-4dd6-aee5-6894900decc3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:13:52.725635 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-de4fe273-768d-4dd6-aee5-6894900decc3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:13:52.865069 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-de4fe273-768d-4dd6-aee5-6894900decc3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:13:52.877789 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-de4fe273-768d-4dd6-aee5-6894900decc3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:13:52.880113 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-de4fe273-768d-4dd6-aee5-6894900decc3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:13:52.881766 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-de4fe273-768d-4dd6-aee5-6894900decc3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1725 microversion: 2.20 time: 0.172416 Aug 31 13:13:52.882576 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 481/935] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:13:52 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:13:53.914502 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-74d46c05-3525-4e60-976c-64e3efa4a77b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:13:53.915424 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-74d46c05-3525-4e60-976c-64e3efa4a77b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:13:53.923265 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-74d46c05-3525-4e60-976c-64e3efa4a77b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:13:53.923863 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-74d46c05-3525-4e60-976c-64e3efa4a77b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:13:53.924355 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-74d46c05-3525-4e60-976c-64e3efa4a77b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:13:53.925207 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-74d46c05-3525-4e60-976c-64e3efa4a77b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:13:53.925723 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-74d46c05-3525-4e60-976c-64e3efa4a77b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:13:53.926222 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-74d46c05-3525-4e60-976c-64e3efa4a77b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:13:54.055765 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-74d46c05-3525-4e60-976c-64e3efa4a77b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:13:54.064577 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-74d46c05-3525-4e60-976c-64e3efa4a77b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:13:54.066013 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-74d46c05-3525-4e60-976c-64e3efa4a77b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:13:54.067181 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-74d46c05-3525-4e60-976c-64e3efa4a77b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1725 microversion: 2.20 time: 0.159571 Aug 31 13:13:54.067756 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 455/936] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:13:53 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:13:55.101093 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-a5b5a0a7-9a0d-4f22-9942-24106e6a6431 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:13:55.101864 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-a5b5a0a7-9a0d-4f22-9942-24106e6a6431 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:13:55.109792 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a5b5a0a7-9a0d-4f22-9942-24106e6a6431 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:13:55.110378 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a5b5a0a7-9a0d-4f22-9942-24106e6a6431 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:13:55.110854 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a5b5a0a7-9a0d-4f22-9942-24106e6a6431 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:13:55.111659 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a5b5a0a7-9a0d-4f22-9942-24106e6a6431 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:13:55.112296 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a5b5a0a7-9a0d-4f22-9942-24106e6a6431 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:13:55.112791 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a5b5a0a7-9a0d-4f22-9942-24106e6a6431 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:13:55.251652 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-a5b5a0a7-9a0d-4f22-9942-24106e6a6431 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:13:55.262271 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-a5b5a0a7-9a0d-4f22-9942-24106e6a6431 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:13:55.263720 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-a5b5a0a7-9a0d-4f22-9942-24106e6a6431 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:13:55.264936 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-a5b5a0a7-9a0d-4f22-9942-24106e6a6431 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1725 microversion: 2.20 time: 0.170760 Aug 31 13:13:55.265488 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 482/937] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:13:55 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:13:56.292277 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-99394bd7-99ee-4085-8c24-3d37da0552f3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:13:56.293129 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-99394bd7-99ee-4085-8c24-3d37da0552f3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:13:56.304387 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-99394bd7-99ee-4085-8c24-3d37da0552f3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:13:56.305011 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-99394bd7-99ee-4085-8c24-3d37da0552f3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:13:56.305436 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-99394bd7-99ee-4085-8c24-3d37da0552f3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:13:56.306106 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-99394bd7-99ee-4085-8c24-3d37da0552f3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:13:56.306563 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-99394bd7-99ee-4085-8c24-3d37da0552f3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:13:56.306974 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-99394bd7-99ee-4085-8c24-3d37da0552f3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:13:56.443612 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-99394bd7-99ee-4085-8c24-3d37da0552f3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:13:56.451908 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-99394bd7-99ee-4085-8c24-3d37da0552f3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:13:56.453350 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-99394bd7-99ee-4085-8c24-3d37da0552f3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:13:56.454635 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-99394bd7-99ee-4085-8c24-3d37da0552f3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1725 microversion: 2.20 time: 0.169024 Aug 31 13:13:56.455204 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 456/938] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:13:56 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:13:57.480564 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-f5a97948-c6d2-43e1-b402-46965895abe9 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:13:57.481243 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-f5a97948-c6d2-43e1-b402-46965895abe9 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:13:57.489303 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f5a97948-c6d2-43e1-b402-46965895abe9 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:13:57.489869 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f5a97948-c6d2-43e1-b402-46965895abe9 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:13:57.490384 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f5a97948-c6d2-43e1-b402-46965895abe9 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:13:57.491195 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f5a97948-c6d2-43e1-b402-46965895abe9 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:13:57.491849 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f5a97948-c6d2-43e1-b402-46965895abe9 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:13:57.492341 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f5a97948-c6d2-43e1-b402-46965895abe9 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:13:57.634770 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-f5a97948-c6d2-43e1-b402-46965895abe9 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:13:57.643235 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-f5a97948-c6d2-43e1-b402-46965895abe9 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:13:57.644719 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-f5a97948-c6d2-43e1-b402-46965895abe9 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:13:57.645891 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-f5a97948-c6d2-43e1-b402-46965895abe9 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1746 microversion: 2.20 time: 0.170480 Aug 31 13:13:57.646463 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 483/939] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:13:57 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1746 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:13:58.675964 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e136dd15-0ef3-48a5-a46e-918e56d561f2 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:13:58.676983 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e136dd15-0ef3-48a5-a46e-918e56d561f2 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:13:58.684676 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e136dd15-0ef3-48a5-a46e-918e56d561f2 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:13:58.685158 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e136dd15-0ef3-48a5-a46e-918e56d561f2 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:13:58.685591 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e136dd15-0ef3-48a5-a46e-918e56d561f2 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:13:58.686281 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e136dd15-0ef3-48a5-a46e-918e56d561f2 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:13:58.686736 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e136dd15-0ef3-48a5-a46e-918e56d561f2 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:13:58.687157 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e136dd15-0ef3-48a5-a46e-918e56d561f2 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:13:58.827422 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e136dd15-0ef3-48a5-a46e-918e56d561f2 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:13:58.836261 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e136dd15-0ef3-48a5-a46e-918e56d561f2 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:13:58.837776 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e136dd15-0ef3-48a5-a46e-918e56d561f2 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:13:58.838945 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e136dd15-0ef3-48a5-a46e-918e56d561f2 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1746 microversion: 2.20 time: 0.171462 Aug 31 13:13:58.839488 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 457/940] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:13:58 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1746 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:13:59.866046 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-f3f29f6b-5899-4fa3-96f1-02c218b54479 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:13:59.867026 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-f3f29f6b-5899-4fa3-96f1-02c218b54479 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:13:59.877947 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f3f29f6b-5899-4fa3-96f1-02c218b54479 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:13:59.878739 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f3f29f6b-5899-4fa3-96f1-02c218b54479 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:13:59.879450 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f3f29f6b-5899-4fa3-96f1-02c218b54479 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:13:59.880620 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f3f29f6b-5899-4fa3-96f1-02c218b54479 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:13:59.881358 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f3f29f6b-5899-4fa3-96f1-02c218b54479 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:13:59.882062 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f3f29f6b-5899-4fa3-96f1-02c218b54479 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:00.015528 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-f3f29f6b-5899-4fa3-96f1-02c218b54479 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:00.024164 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-f3f29f6b-5899-4fa3-96f1-02c218b54479 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:00.025597 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-f3f29f6b-5899-4fa3-96f1-02c218b54479 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:00.026754 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-f3f29f6b-5899-4fa3-96f1-02c218b54479 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1746 microversion: 2.20 time: 0.167267 Aug 31 13:14:00.027320 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 484/941] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:13:59 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1746 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:14:01.061976 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-1b421191-fab9-4c7b-8056-eb16d03f05f9 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:14:01.062877 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-1b421191-fab9-4c7b-8056-eb16d03f05f9 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:14:01.072208 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1b421191-fab9-4c7b-8056-eb16d03f05f9 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:01.072687 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1b421191-fab9-4c7b-8056-eb16d03f05f9 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:01.073128 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1b421191-fab9-4c7b-8056-eb16d03f05f9 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:01.073821 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1b421191-fab9-4c7b-8056-eb16d03f05f9 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:01.074272 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1b421191-fab9-4c7b-8056-eb16d03f05f9 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:01.074694 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1b421191-fab9-4c7b-8056-eb16d03f05f9 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:01.214027 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-1b421191-fab9-4c7b-8056-eb16d03f05f9 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:01.222514 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-1b421191-fab9-4c7b-8056-eb16d03f05f9 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:01.223862 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-1b421191-fab9-4c7b-8056-eb16d03f05f9 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:01.225051 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-1b421191-fab9-4c7b-8056-eb16d03f05f9 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1746 microversion: 2.20 time: 0.169286 Aug 31 13:14:01.225598 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 458/942] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:14:01 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1746 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:14:01.341330 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-cac56c74-4af4-4ee6-ba32-74946e925132 req-3b8f16d3-bf9d-4aee-96af-8c1f7d211134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b02d1346-91cf-4003-a5f4-8ae3e32d6e75", "name": "network-vif-plugged", "status": "completed", "tag": "51d49abf-a001-4e75-bc6f-08a55177cf60"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:14:01.352924 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-cac56c74-4af4-4ee6-ba32-74946e925132 req-3b8f16d3-bf9d-4aee-96af-8c1f7d211134 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:01.353394 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-cac56c74-4af4-4ee6-ba32-74946e925132 req-3b8f16d3-bf9d-4aee-96af-8c1f7d211134 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:01.353817 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-cac56c74-4af4-4ee6-ba32-74946e925132 req-3b8f16d3-bf9d-4aee-96af-8c1f7d211134 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:01.366608 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-cac56c74-4af4-4ee6-ba32-74946e925132 req-3b8f16d3-bf9d-4aee-96af-8c1f7d211134 service nova] Creating event network-vif-plugged:51d49abf-a001-4e75-bc6f-08a55177cf60 for instance b02d1346-91cf-4003-a5f4-8ae3e32d6e75 on hv-cinder-85442 Aug 31 13:14:01.372088 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-cac56c74-4af4-4ee6-ba32-74946e925132 req-3b8f16d3-bf9d-4aee-96af-8c1f7d211134 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034408 Aug 31 13:14:01.372680 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 485/943] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:14:02.252888 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-590beed0-6104-469e-8bd4-0e23f4cea09a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:14:02.253748 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-590beed0-6104-469e-8bd4-0e23f4cea09a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:14:02.264739 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-590beed0-6104-469e-8bd4-0e23f4cea09a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:02.265520 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-590beed0-6104-469e-8bd4-0e23f4cea09a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:02.266229 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-590beed0-6104-469e-8bd4-0e23f4cea09a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:02.267381 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-590beed0-6104-469e-8bd4-0e23f4cea09a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:02.268168 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-590beed0-6104-469e-8bd4-0e23f4cea09a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:02.268861 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-590beed0-6104-469e-8bd4-0e23f4cea09a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:02.413732 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-590beed0-6104-469e-8bd4-0e23f4cea09a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:02.422259 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-590beed0-6104-469e-8bd4-0e23f4cea09a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:02.423700 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-590beed0-6104-469e-8bd4-0e23f4cea09a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:02.424918 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-590beed0-6104-469e-8bd4-0e23f4cea09a tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1746 microversion: 2.20 time: 0.178732 Aug 31 13:14:02.425462 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 459/944] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:14:02 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1746 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:14:03.450400 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-4822ba29-d01b-4e89-8600-2b9343111a8e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:14:03.451701 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-4822ba29-d01b-4e89-8600-2b9343111a8e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:14:03.460609 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4822ba29-d01b-4e89-8600-2b9343111a8e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:03.461091 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4822ba29-d01b-4e89-8600-2b9343111a8e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:03.461522 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4822ba29-d01b-4e89-8600-2b9343111a8e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:03.462212 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4822ba29-d01b-4e89-8600-2b9343111a8e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:03.462663 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4822ba29-d01b-4e89-8600-2b9343111a8e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:03.463086 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4822ba29-d01b-4e89-8600-2b9343111a8e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:03.600155 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-4822ba29-d01b-4e89-8600-2b9343111a8e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:03.609583 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-4822ba29-d01b-4e89-8600-2b9343111a8e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:03.611146 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-4822ba29-d01b-4e89-8600-2b9343111a8e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:03.612439 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-4822ba29-d01b-4e89-8600-2b9343111a8e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1741 microversion: 2.20 time: 0.166389 Aug 31 13:14:03.613081 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 486/945] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:14:03 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1741 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:14:04.636534 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-047f9ddb-b6f6-424c-8083-97444dc5f4de tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:14:04.638783 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-047f9ddb-b6f6-424c-8083-97444dc5f4de tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:14:04.645937 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-047f9ddb-b6f6-424c-8083-97444dc5f4de tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:04.646780 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-047f9ddb-b6f6-424c-8083-97444dc5f4de tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:04.647274 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-047f9ddb-b6f6-424c-8083-97444dc5f4de tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:04.648321 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-047f9ddb-b6f6-424c-8083-97444dc5f4de tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:04.648832 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-047f9ddb-b6f6-424c-8083-97444dc5f4de tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:04.649309 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-047f9ddb-b6f6-424c-8083-97444dc5f4de tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:04.879392 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-047f9ddb-b6f6-424c-8083-97444dc5f4de tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:04.889378 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-047f9ddb-b6f6-424c-8083-97444dc5f4de tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:04.891041 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-047f9ddb-b6f6-424c-8083-97444dc5f4de tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:04.894895 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-047f9ddb-b6f6-424c-8083-97444dc5f4de tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1741 microversion: 2.20 time: 0.261035 Aug 31 13:14:04.896649 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 460/946] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:14:04 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1741 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:14:05.920105 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-faa5d5bd-c2d5-4003-ad20-ad7463a99b10 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:14:05.921577 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-faa5d5bd-c2d5-4003-ad20-ad7463a99b10 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:14:05.929231 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-faa5d5bd-c2d5-4003-ad20-ad7463a99b10 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:05.929719 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-faa5d5bd-c2d5-4003-ad20-ad7463a99b10 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:05.930152 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-faa5d5bd-c2d5-4003-ad20-ad7463a99b10 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:05.930911 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-faa5d5bd-c2d5-4003-ad20-ad7463a99b10 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:05.931654 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-faa5d5bd-c2d5-4003-ad20-ad7463a99b10 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:05.932098 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-faa5d5bd-c2d5-4003-ad20-ad7463a99b10 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:06.068536 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-faa5d5bd-c2d5-4003-ad20-ad7463a99b10 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:06.077007 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-faa5d5bd-c2d5-4003-ad20-ad7463a99b10 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:06.078445 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-faa5d5bd-c2d5-4003-ad20-ad7463a99b10 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:06.079659 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-faa5d5bd-c2d5-4003-ad20-ad7463a99b10 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1741 microversion: 2.20 time: 0.164608 Aug 31 13:14:06.089058 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 487/947] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:14:05 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1741 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:14:07.102998 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-33e1809e-0390-4309-8088-2689524c23c8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:14:07.103600 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-33e1809e-0390-4309-8088-2689524c23c8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:14:07.110700 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-33e1809e-0390-4309-8088-2689524c23c8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:07.111182 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-33e1809e-0390-4309-8088-2689524c23c8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:07.111968 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-33e1809e-0390-4309-8088-2689524c23c8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:07.112356 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-33e1809e-0390-4309-8088-2689524c23c8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:07.112801 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-33e1809e-0390-4309-8088-2689524c23c8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:07.113219 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-33e1809e-0390-4309-8088-2689524c23c8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:07.252106 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-33e1809e-0390-4309-8088-2689524c23c8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:07.260636 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-33e1809e-0390-4309-8088-2689524c23c8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:07.262147 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-33e1809e-0390-4309-8088-2689524c23c8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:07.263895 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-33e1809e-0390-4309-8088-2689524c23c8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1741 microversion: 2.20 time: 0.164484 Aug 31 13:14:07.264039 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 461/948] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:14:07 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1741 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:14:08.286844 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-09fc52bd-271d-42e6-a09a-0bd73883dbc2 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:14:08.287396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-09fc52bd-271d-42e6-a09a-0bd73883dbc2 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:14:08.295387 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-09fc52bd-271d-42e6-a09a-0bd73883dbc2 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:08.296430 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-09fc52bd-271d-42e6-a09a-0bd73883dbc2 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:08.297114 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-09fc52bd-271d-42e6-a09a-0bd73883dbc2 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:08.298263 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-09fc52bd-271d-42e6-a09a-0bd73883dbc2 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:08.298779 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-09fc52bd-271d-42e6-a09a-0bd73883dbc2 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:08.299261 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-09fc52bd-271d-42e6-a09a-0bd73883dbc2 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:08.448588 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-09fc52bd-271d-42e6-a09a-0bd73883dbc2 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:08.460057 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-09fc52bd-271d-42e6-a09a-0bd73883dbc2 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:08.461843 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-09fc52bd-271d-42e6-a09a-0bd73883dbc2 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:08.463023 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-09fc52bd-271d-42e6-a09a-0bd73883dbc2 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1741 microversion: 2.20 time: 0.180821 Aug 31 13:14:08.464137 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 488/949] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:14:08 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1741 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:14:09.487230 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-77bcf0b9-4fb3-44d8-8f87-e64c97a27cba tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:14:09.487916 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-77bcf0b9-4fb3-44d8-8f87-e64c97a27cba tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:14:09.495468 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-77bcf0b9-4fb3-44d8-8f87-e64c97a27cba tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:09.495996 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-77bcf0b9-4fb3-44d8-8f87-e64c97a27cba tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:09.496428 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-77bcf0b9-4fb3-44d8-8f87-e64c97a27cba tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:09.497128 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-77bcf0b9-4fb3-44d8-8f87-e64c97a27cba tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:09.497575 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-77bcf0b9-4fb3-44d8-8f87-e64c97a27cba tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:09.497996 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-77bcf0b9-4fb3-44d8-8f87-e64c97a27cba tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:09.663216 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-77bcf0b9-4fb3-44d8-8f87-e64c97a27cba tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:09.673709 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-77bcf0b9-4fb3-44d8-8f87-e64c97a27cba tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:09.675152 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-77bcf0b9-4fb3-44d8-8f87-e64c97a27cba tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:09.676391 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-77bcf0b9-4fb3-44d8-8f87-e64c97a27cba tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1741 microversion: 2.20 time: 0.193362 Aug 31 13:14:09.677178 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 462/950] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:14:09 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1741 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:14:10.699050 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-a65e3cf3-2108-4a7b-b668-c929cd62a184 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:14:10.700386 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-a65e3cf3-2108-4a7b-b668-c929cd62a184 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:14:10.708456 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a65e3cf3-2108-4a7b-b668-c929cd62a184 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:10.708938 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a65e3cf3-2108-4a7b-b668-c929cd62a184 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:10.709393 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a65e3cf3-2108-4a7b-b668-c929cd62a184 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:10.710148 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a65e3cf3-2108-4a7b-b668-c929cd62a184 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:10.710699 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a65e3cf3-2108-4a7b-b668-c929cd62a184 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:10.711141 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a65e3cf3-2108-4a7b-b668-c929cd62a184 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:10.850430 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-a65e3cf3-2108-4a7b-b668-c929cd62a184 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:10.867215 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-a65e3cf3-2108-4a7b-b668-c929cd62a184 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:10.868444 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-a65e3cf3-2108-4a7b-b668-c929cd62a184 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:10.869666 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-a65e3cf3-2108-4a7b-b668-c929cd62a184 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1741 microversion: 2.20 time: 0.174948 Aug 31 13:14:10.870905 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 489/951] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:14:10 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1741 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:14:11.893691 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-31879728-befd-4eef-9977-ff4dfb0bc3a0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:14:11.894245 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-31879728-befd-4eef-9977-ff4dfb0bc3a0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:14:11.902883 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-31879728-befd-4eef-9977-ff4dfb0bc3a0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:11.903511 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-31879728-befd-4eef-9977-ff4dfb0bc3a0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:11.903989 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-31879728-befd-4eef-9977-ff4dfb0bc3a0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:11.905226 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-31879728-befd-4eef-9977-ff4dfb0bc3a0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:11.905702 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-31879728-befd-4eef-9977-ff4dfb0bc3a0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:11.906109 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-31879728-befd-4eef-9977-ff4dfb0bc3a0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:12.066433 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-31879728-befd-4eef-9977-ff4dfb0bc3a0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:12.077156 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-31879728-befd-4eef-9977-ff4dfb0bc3a0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:12.078601 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-31879728-befd-4eef-9977-ff4dfb0bc3a0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:12.079792 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-31879728-befd-4eef-9977-ff4dfb0bc3a0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1741 microversion: 2.20 time: 0.190722 Aug 31 13:14:12.080383 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 463/952] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:14:11 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1741 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:14:13.103171 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-08e1ac28-ba0a-4a68-a51d-0da2a24ce4f6 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:14:13.103909 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-08e1ac28-ba0a-4a68-a51d-0da2a24ce4f6 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:14:13.110119 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-08e1ac28-ba0a-4a68-a51d-0da2a24ce4f6 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:13.110586 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-08e1ac28-ba0a-4a68-a51d-0da2a24ce4f6 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:13.111023 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-08e1ac28-ba0a-4a68-a51d-0da2a24ce4f6 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:13.111714 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-08e1ac28-ba0a-4a68-a51d-0da2a24ce4f6 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:13.112201 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-08e1ac28-ba0a-4a68-a51d-0da2a24ce4f6 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:13.112861 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-08e1ac28-ba0a-4a68-a51d-0da2a24ce4f6 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:13.303990 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-08e1ac28-ba0a-4a68-a51d-0da2a24ce4f6 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:13.312307 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-08e1ac28-ba0a-4a68-a51d-0da2a24ce4f6 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:13.313745 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-08e1ac28-ba0a-4a68-a51d-0da2a24ce4f6 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:13.314926 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-08e1ac28-ba0a-4a68-a51d-0da2a24ce4f6 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1741 microversion: 2.20 time: 0.216218 Aug 31 13:14:13.315512 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 490/953] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:14:13 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1741 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:14:14.338296 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-71cf90c6-e90b-4387-836a-2af02e5108f4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:14:14.338892 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-71cf90c6-e90b-4387-836a-2af02e5108f4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:14:14.345810 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-71cf90c6-e90b-4387-836a-2af02e5108f4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:14.346291 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-71cf90c6-e90b-4387-836a-2af02e5108f4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:14.346703 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-71cf90c6-e90b-4387-836a-2af02e5108f4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:14.347417 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-71cf90c6-e90b-4387-836a-2af02e5108f4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:14.347860 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-71cf90c6-e90b-4387-836a-2af02e5108f4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:14.348303 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-71cf90c6-e90b-4387-836a-2af02e5108f4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:14.478258 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-71cf90c6-e90b-4387-836a-2af02e5108f4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:14.488450 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-71cf90c6-e90b-4387-836a-2af02e5108f4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:14.489894 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-71cf90c6-e90b-4387-836a-2af02e5108f4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:14.491075 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-71cf90c6-e90b-4387-836a-2af02e5108f4 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1723 microversion: 2.20 time: 0.156831 Aug 31 13:14:14.491840 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 464/954] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:14:14 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:14:15.514783 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-1c96658f-e4fc-45bb-bbc3-0a9035b8463c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:14:15.515465 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-1c96658f-e4fc-45bb-bbc3-0a9035b8463c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:14:15.517978 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_api:SELECT=29 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:14:15.523086 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1c96658f-e4fc-45bb-bbc3-0a9035b8463c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:15.523566 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1c96658f-e4fc-45bb-bbc3-0a9035b8463c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:15.524034 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1c96658f-e4fc-45bb-bbc3-0a9035b8463c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:15.524735 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1c96658f-e4fc-45bb-bbc3-0a9035b8463c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:15.525183 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1c96658f-e4fc-45bb-bbc3-0a9035b8463c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:15.525608 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1c96658f-e4fc-45bb-bbc3-0a9035b8463c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:15.528695 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell1:SELECT=79 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:14:15.674781 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-1c96658f-e4fc-45bb-bbc3-0a9035b8463c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:15.684775 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-1c96658f-e4fc-45bb-bbc3-0a9035b8463c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:15.686200 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-1c96658f-e4fc-45bb-bbc3-0a9035b8463c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:15.687554 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-1c96658f-e4fc-45bb-bbc3-0a9035b8463c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1723 microversion: 2.20 time: 0.176849 Aug 31 13:14:15.688165 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 491/955] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:14:15 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:14:16.711724 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-6e86eff8-beef-4ebd-b4a2-ae251b96cfb3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:14:16.714076 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-6e86eff8-beef-4ebd-b4a2-ae251b96cfb3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:14:16.716738 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=29 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:14:16.722298 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6e86eff8-beef-4ebd-b4a2-ae251b96cfb3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:16.722769 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6e86eff8-beef-4ebd-b4a2-ae251b96cfb3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:16.723197 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6e86eff8-beef-4ebd-b4a2-ae251b96cfb3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:16.723914 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6e86eff8-beef-4ebd-b4a2-ae251b96cfb3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:16.724359 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6e86eff8-beef-4ebd-b4a2-ae251b96cfb3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:16.724800 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6e86eff8-beef-4ebd-b4a2-ae251b96cfb3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:16.727844 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:14:16.854390 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-6e86eff8-beef-4ebd-b4a2-ae251b96cfb3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:16.862896 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-6e86eff8-beef-4ebd-b4a2-ae251b96cfb3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:16.864351 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-6e86eff8-beef-4ebd-b4a2-ae251b96cfb3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:16.865497 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-6e86eff8-beef-4ebd-b4a2-ae251b96cfb3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1723 microversion: 2.20 time: 0.158672 Aug 31 13:14:16.866059 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 465/956] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:14:16 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:14:17.410363 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-ccf5d364-5749-46ae-be10-4d05b54a4d5f req-8c8307c0-5e48-4c57-b0e8-ce6c1e6b4341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b02d1346-91cf-4003-a5f4-8ae3e32d6e75", "name": "network-vif-unplugged", "status": "completed", "tag": "51d49abf-a001-4e75-bc6f-08a55177cf60"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:14:17.423096 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-ccf5d364-5749-46ae-be10-4d05b54a4d5f req-8c8307c0-5e48-4c57-b0e8-ce6c1e6b4341 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:17.423757 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-ccf5d364-5749-46ae-be10-4d05b54a4d5f req-8c8307c0-5e48-4c57-b0e8-ce6c1e6b4341 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:17.426222 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-ccf5d364-5749-46ae-be10-4d05b54a4d5f req-8c8307c0-5e48-4c57-b0e8-ce6c1e6b4341 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:17.441612 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-ccf5d364-5749-46ae-be10-4d05b54a4d5f req-8c8307c0-5e48-4c57-b0e8-ce6c1e6b4341 service nova] Creating event network-vif-unplugged:51d49abf-a001-4e75-bc6f-08a55177cf60 for instance b02d1346-91cf-4003-a5f4-8ae3e32d6e75 on hv-cinder-85442 Aug 31 13:14:17.447446 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-ccf5d364-5749-46ae-be10-4d05b54a4d5f req-8c8307c0-5e48-4c57-b0e8-ce6c1e6b4341 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041348 Aug 31 13:14:17.448416 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 492/957] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:14:17.893007 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-061ee574-8089-4894-93f7-2d07e0a2e99f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:14:17.893980 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-061ee574-8089-4894-93f7-2d07e0a2e99f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:14:17.905711 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-061ee574-8089-4894-93f7-2d07e0a2e99f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:17.906505 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-061ee574-8089-4894-93f7-2d07e0a2e99f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:17.907233 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-061ee574-8089-4894-93f7-2d07e0a2e99f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:17.908412 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-061ee574-8089-4894-93f7-2d07e0a2e99f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:17.909210 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-061ee574-8089-4894-93f7-2d07e0a2e99f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:17.909914 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-061ee574-8089-4894-93f7-2d07e0a2e99f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:18.041292 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-061ee574-8089-4894-93f7-2d07e0a2e99f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:18.049779 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-061ee574-8089-4894-93f7-2d07e0a2e99f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:18.051220 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-061ee574-8089-4894-93f7-2d07e0a2e99f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:18.052439 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-061ee574-8089-4894-93f7-2d07e0a2e99f tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1666 microversion: 2.20 time: 0.166137 Aug 31 13:14:18.052977 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 466/958] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:14:17 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1666 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:14:18.076160 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-e5cd38f1-d820-4696-8ff0-739cd047050d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5de18a78-7583-4249-a942-90057308f06f"}} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:14:18.078677 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-e5cd38f1-d820-4696-8ff0-739cd047050d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:14:18.085231 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e5cd38f1-d820-4696-8ff0-739cd047050d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:18.085743 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e5cd38f1-d820-4696-8ff0-739cd047050d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:18.086179 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e5cd38f1-d820-4696-8ff0-739cd047050d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:18.086908 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e5cd38f1-d820-4696-8ff0-739cd047050d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:18.087355 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e5cd38f1-d820-4696-8ff0-739cd047050d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:18.087793 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e5cd38f1-d820-4696-8ff0-739cd047050d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:18.374627 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-e5cd38f1-d820-4696-8ff0-739cd047050d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "POST /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.302830 Aug 31 13:14:18.375253 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 493/959] 10.222.0.58 () {62 vars in 1364 bytes} [Wed Aug 31 13:14:18 2022] POST /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75/os-volume_attachments => generated 188 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:14:18.504046 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e597a598-21e5-48a0-bc31-8f612c492dbc tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:14:18.504570 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e597a598-21e5-48a0-bc31-8f612c492dbc tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:14:18.511022 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e597a598-21e5-48a0-bc31-8f612c492dbc tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:18.511504 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e597a598-21e5-48a0-bc31-8f612c492dbc tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:18.511983 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e597a598-21e5-48a0-bc31-8f612c492dbc tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:18.512673 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e597a598-21e5-48a0-bc31-8f612c492dbc tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:18.513127 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e597a598-21e5-48a0-bc31-8f612c492dbc tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:18.513546 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e597a598-21e5-48a0-bc31-8f612c492dbc tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:18.785200 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e597a598-21e5-48a0-bc31-8f612c492dbc tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75/os-volume_attachments/5de18a78-7583-4249-a942-90057308f06f" status: 202 len: 0 microversion: 2.20 time: 0.285021 Aug 31 13:14:18.785767 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 467/960] 10.222.0.58 () {60 vars in 1457 bytes} [Wed Aug 31 13:14:18 2022] DELETE /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75/os-volume_attachments/5de18a78-7583-4249-a942-90057308f06f => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:14:18.846926 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-5fec3d59-e7e2-40b2-bbd3-31eb7cb0067d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:14:18.847502 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-5fec3d59-e7e2-40b2-bbd3-31eb7cb0067d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:14:18.854682 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5fec3d59-e7e2-40b2-bbd3-31eb7cb0067d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:18.855166 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5fec3d59-e7e2-40b2-bbd3-31eb7cb0067d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:18.855594 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5fec3d59-e7e2-40b2-bbd3-31eb7cb0067d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:18.856327 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5fec3d59-e7e2-40b2-bbd3-31eb7cb0067d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:18.856771 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5fec3d59-e7e2-40b2-bbd3-31eb7cb0067d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:18.857188 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5fec3d59-e7e2-40b2-bbd3-31eb7cb0067d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:18.952287 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-5fec3d59-e7e2-40b2-bbd3-31eb7cb0067d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120704) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 13:14:19.032542 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-5fec3d59-e7e2-40b2-bbd3-31eb7cb0067d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "POST /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75/action" status: 202 len: 0 microversion: 2.20 time: 0.189524 Aug 31 13:14:19.033171 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 494/961] 10.222.0.58 () {62 vars in 1319 bytes} [Wed Aug 31 13:14:18 2022] POST /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:14:19.041323 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3cceee8e-e8d5-42d9-8dca-f01874b01002 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:14:19.042067 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-3cceee8e-e8d5-42d9-8dca-f01874b01002 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:14:19.049079 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3cceee8e-e8d5-42d9-8dca-f01874b01002 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:19.049559 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3cceee8e-e8d5-42d9-8dca-f01874b01002 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:19.049996 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3cceee8e-e8d5-42d9-8dca-f01874b01002 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:19.050693 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3cceee8e-e8d5-42d9-8dca-f01874b01002 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:19.051143 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3cceee8e-e8d5-42d9-8dca-f01874b01002 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:19.051573 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3cceee8e-e8d5-42d9-8dca-f01874b01002 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:19.187627 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-3cceee8e-e8d5-42d9-8dca-f01874b01002 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:19.196087 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-3cceee8e-e8d5-42d9-8dca-f01874b01002 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:19.197661 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-3cceee8e-e8d5-42d9-8dca-f01874b01002 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:19.198858 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-3cceee8e-e8d5-42d9-8dca-f01874b01002 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1674 microversion: 2.20 time: 0.161488 Aug 31 13:14:19.199439 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 468/962] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:14:19 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:14:20.221934 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-aaaecbc4-13fd-4d54-be39-0f990b12b614 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:14:20.222776 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-aaaecbc4-13fd-4d54-be39-0f990b12b614 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:14:20.229996 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-aaaecbc4-13fd-4d54-be39-0f990b12b614 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:20.230470 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-aaaecbc4-13fd-4d54-be39-0f990b12b614 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:20.230902 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-aaaecbc4-13fd-4d54-be39-0f990b12b614 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:20.231593 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-aaaecbc4-13fd-4d54-be39-0f990b12b614 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:20.232070 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-aaaecbc4-13fd-4d54-be39-0f990b12b614 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:20.232487 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-aaaecbc4-13fd-4d54-be39-0f990b12b614 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:20.369446 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-aaaecbc4-13fd-4d54-be39-0f990b12b614 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:20.378236 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-aaaecbc4-13fd-4d54-be39-0f990b12b614 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:20.379664 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-aaaecbc4-13fd-4d54-be39-0f990b12b614 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:20.380905 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-aaaecbc4-13fd-4d54-be39-0f990b12b614 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1732 microversion: 2.20 time: 0.163012 Aug 31 13:14:20.381506 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 495/963] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:14:20 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:14:21.405896 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-4d472856-9f09-4b50-bfd5-52edb83452ad tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:14:21.406616 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-4d472856-9f09-4b50-bfd5-52edb83452ad tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:14:21.418061 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4d472856-9f09-4b50-bfd5-52edb83452ad tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:21.418538 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4d472856-9f09-4b50-bfd5-52edb83452ad tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:21.418970 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4d472856-9f09-4b50-bfd5-52edb83452ad tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:21.419671 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4d472856-9f09-4b50-bfd5-52edb83452ad tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:21.420143 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4d472856-9f09-4b50-bfd5-52edb83452ad tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:21.420563 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4d472856-9f09-4b50-bfd5-52edb83452ad tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:21.611840 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-4d472856-9f09-4b50-bfd5-52edb83452ad tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:21.620963 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-4d472856-9f09-4b50-bfd5-52edb83452ad tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:21.622683 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-4d472856-9f09-4b50-bfd5-52edb83452ad tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:21.624097 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-4d472856-9f09-4b50-bfd5-52edb83452ad tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1732 microversion: 2.20 time: 0.222555 Aug 31 13:14:21.625349 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 469/964] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:14:21 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1732 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:14:22.648554 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-e2fbeba5-7e17-4048-8457-c6f622acb060 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:14:22.649294 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-e2fbeba5-7e17-4048-8457-c6f622acb060 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:14:22.656666 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e2fbeba5-7e17-4048-8457-c6f622acb060 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:22.657374 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e2fbeba5-7e17-4048-8457-c6f622acb060 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:22.657942 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e2fbeba5-7e17-4048-8457-c6f622acb060 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:22.658715 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e2fbeba5-7e17-4048-8457-c6f622acb060 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:22.659163 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e2fbeba5-7e17-4048-8457-c6f622acb060 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:22.664331 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e2fbeba5-7e17-4048-8457-c6f622acb060 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:22.805959 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-e2fbeba5-7e17-4048-8457-c6f622acb060 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:22.814342 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-e2fbeba5-7e17-4048-8457-c6f622acb060 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:22.815916 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-e2fbeba5-7e17-4048-8457-c6f622acb060 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:22.817207 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-e2fbeba5-7e17-4048-8457-c6f622acb060 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1732 microversion: 2.20 time: 0.172871 Aug 31 13:14:22.817798 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 496/965] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:14:22 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:14:23.841808 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-d9e200ff-d397-4fcb-8e78-b6716e45acbc tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:14:23.842397 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-d9e200ff-d397-4fcb-8e78-b6716e45acbc tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:14:23.848992 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d9e200ff-d397-4fcb-8e78-b6716e45acbc tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:23.849480 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d9e200ff-d397-4fcb-8e78-b6716e45acbc tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:23.849907 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d9e200ff-d397-4fcb-8e78-b6716e45acbc tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:23.850592 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d9e200ff-d397-4fcb-8e78-b6716e45acbc tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:23.851032 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d9e200ff-d397-4fcb-8e78-b6716e45acbc tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:23.851439 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d9e200ff-d397-4fcb-8e78-b6716e45acbc tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:24.441903 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-d9e200ff-d397-4fcb-8e78-b6716e45acbc tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:24.450663 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-d9e200ff-d397-4fcb-8e78-b6716e45acbc tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:24.452126 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-d9e200ff-d397-4fcb-8e78-b6716e45acbc tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:24.453328 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-d9e200ff-d397-4fcb-8e78-b6716e45acbc tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1732 microversion: 2.20 time: 0.616524 Aug 31 13:14:24.454092 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 470/966] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:14:23 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1732 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:14:25.477783 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-6fbde682-8eb5-4167-9016-58ae4360935b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:14:25.478372 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-6fbde682-8eb5-4167-9016-58ae4360935b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:14:25.485334 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6fbde682-8eb5-4167-9016-58ae4360935b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:25.485826 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6fbde682-8eb5-4167-9016-58ae4360935b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:25.486331 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6fbde682-8eb5-4167-9016-58ae4360935b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:25.487052 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6fbde682-8eb5-4167-9016-58ae4360935b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:25.487538 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6fbde682-8eb5-4167-9016-58ae4360935b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:25.487998 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6fbde682-8eb5-4167-9016-58ae4360935b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:25.634811 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-6fbde682-8eb5-4167-9016-58ae4360935b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:25.644181 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-6fbde682-8eb5-4167-9016-58ae4360935b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:25.645643 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-6fbde682-8eb5-4167-9016-58ae4360935b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:25.646994 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-6fbde682-8eb5-4167-9016-58ae4360935b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1732 microversion: 2.20 time: 0.173059 Aug 31 13:14:25.647760 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 497/967] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:14:25 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:14:26.676166 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-692578ad-c4a6-4567-b30e-74459bd11915 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:14:26.676811 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-692578ad-c4a6-4567-b30e-74459bd11915 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:14:26.683848 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-692578ad-c4a6-4567-b30e-74459bd11915 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:26.684622 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-692578ad-c4a6-4567-b30e-74459bd11915 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:26.685273 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-692578ad-c4a6-4567-b30e-74459bd11915 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:26.686044 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-692578ad-c4a6-4567-b30e-74459bd11915 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:26.686574 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-692578ad-c4a6-4567-b30e-74459bd11915 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:26.687050 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-692578ad-c4a6-4567-b30e-74459bd11915 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:26.843687 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-692578ad-c4a6-4567-b30e-74459bd11915 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:26.852747 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-692578ad-c4a6-4567-b30e-74459bd11915 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:26.854164 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-692578ad-c4a6-4567-b30e-74459bd11915 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:26.855326 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-692578ad-c4a6-4567-b30e-74459bd11915 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1732 microversion: 2.20 time: 0.183314 Aug 31 13:14:26.855893 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 471/968] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:14:26 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1732 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:14:27.877804 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-18e65db3-e2f3-4913-8f57-da1311c17826 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:14:27.878428 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-18e65db3-e2f3-4913-8f57-da1311c17826 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:14:27.885349 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-18e65db3-e2f3-4913-8f57-da1311c17826 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:27.886216 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-18e65db3-e2f3-4913-8f57-da1311c17826 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:27.886649 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-18e65db3-e2f3-4913-8f57-da1311c17826 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:27.887352 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-18e65db3-e2f3-4913-8f57-da1311c17826 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:27.887856 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-18e65db3-e2f3-4913-8f57-da1311c17826 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:27.888272 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-18e65db3-e2f3-4913-8f57-da1311c17826 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:28.031621 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-18e65db3-e2f3-4913-8f57-da1311c17826 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:28.040185 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-18e65db3-e2f3-4913-8f57-da1311c17826 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:28.041763 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-18e65db3-e2f3-4913-8f57-da1311c17826 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:28.043009 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-18e65db3-e2f3-4913-8f57-da1311c17826 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1732 microversion: 2.20 time: 0.169208 Aug 31 13:14:28.043577 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 498/969] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:14:27 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:14:29.070783 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3a1b9248-183c-418a-912a-a40019835e06 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:14:29.071770 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-3a1b9248-183c-418a-912a-a40019835e06 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:14:29.083104 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3a1b9248-183c-418a-912a-a40019835e06 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:29.084028 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3a1b9248-183c-418a-912a-a40019835e06 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:29.084744 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3a1b9248-183c-418a-912a-a40019835e06 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:29.085897 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3a1b9248-183c-418a-912a-a40019835e06 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:29.086642 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3a1b9248-183c-418a-912a-a40019835e06 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:29.087346 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3a1b9248-183c-418a-912a-a40019835e06 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:29.225528 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-3a1b9248-183c-418a-912a-a40019835e06 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:29.238627 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-3a1b9248-183c-418a-912a-a40019835e06 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:29.240992 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-3a1b9248-183c-418a-912a-a40019835e06 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:29.242778 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-3a1b9248-183c-418a-912a-a40019835e06 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1732 microversion: 2.20 time: 0.178336 Aug 31 13:14:29.243596 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 472/970] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:14:29 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1732 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:14:30.270877 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-9ea9ef3a-4d13-4015-bb1f-b42198eba6bf tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:14:30.271779 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-9ea9ef3a-4d13-4015-bb1f-b42198eba6bf tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:14:30.283731 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9ea9ef3a-4d13-4015-bb1f-b42198eba6bf tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:30.284614 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9ea9ef3a-4d13-4015-bb1f-b42198eba6bf tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:30.285334 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9ea9ef3a-4d13-4015-bb1f-b42198eba6bf tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:30.286539 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9ea9ef3a-4d13-4015-bb1f-b42198eba6bf tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:30.287257 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9ea9ef3a-4d13-4015-bb1f-b42198eba6bf tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:30.287997 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9ea9ef3a-4d13-4015-bb1f-b42198eba6bf tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:30.423558 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-9ea9ef3a-4d13-4015-bb1f-b42198eba6bf tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:30.432540 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-9ea9ef3a-4d13-4015-bb1f-b42198eba6bf tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:30.434031 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-9ea9ef3a-4d13-4015-bb1f-b42198eba6bf tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:30.435247 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-9ea9ef3a-4d13-4015-bb1f-b42198eba6bf tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1732 microversion: 2.20 time: 0.170867 Aug 31 13:14:30.435841 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 499/971] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:14:30 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:14:31.467951 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-74c9ac58-69d3-480e-acc7-03958c9dbe4d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:14:31.468765 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-74c9ac58-69d3-480e-acc7-03958c9dbe4d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:14:31.478015 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-74c9ac58-69d3-480e-acc7-03958c9dbe4d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:31.478660 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-74c9ac58-69d3-480e-acc7-03958c9dbe4d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:31.479233 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-74c9ac58-69d3-480e-acc7-03958c9dbe4d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:31.480186 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-74c9ac58-69d3-480e-acc7-03958c9dbe4d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:31.480785 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-74c9ac58-69d3-480e-acc7-03958c9dbe4d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:31.481347 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-74c9ac58-69d3-480e-acc7-03958c9dbe4d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:31.618212 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-74c9ac58-69d3-480e-acc7-03958c9dbe4d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:31.626631 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-74c9ac58-69d3-480e-acc7-03958c9dbe4d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:31.628099 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-74c9ac58-69d3-480e-acc7-03958c9dbe4d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:31.629269 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-74c9ac58-69d3-480e-acc7-03958c9dbe4d tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1732 microversion: 2.20 time: 0.167874 Aug 31 13:14:31.629823 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 473/972] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:14:31 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:14:32.657130 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-a9e347ac-2f39-491d-8d26-8a9bdfd850f3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:14:32.658076 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-a9e347ac-2f39-491d-8d26-8a9bdfd850f3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:14:32.669202 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a9e347ac-2f39-491d-8d26-8a9bdfd850f3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:32.669673 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a9e347ac-2f39-491d-8d26-8a9bdfd850f3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:32.670101 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a9e347ac-2f39-491d-8d26-8a9bdfd850f3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:32.670782 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a9e347ac-2f39-491d-8d26-8a9bdfd850f3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:32.671245 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a9e347ac-2f39-491d-8d26-8a9bdfd850f3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:32.671754 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-a9e347ac-2f39-491d-8d26-8a9bdfd850f3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:32.817400 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-a9e347ac-2f39-491d-8d26-8a9bdfd850f3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:32.829519 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-a9e347ac-2f39-491d-8d26-8a9bdfd850f3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:32.831692 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-a9e347ac-2f39-491d-8d26-8a9bdfd850f3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:32.833667 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-a9e347ac-2f39-491d-8d26-8a9bdfd850f3 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1732 microversion: 2.20 time: 0.183441 Aug 31 13:14:32.834572 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 500/973] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:14:32 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1732 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:14:33.863244 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-314497ed-b07b-48f7-af99-3205dfb6364c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:14:33.863928 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-314497ed-b07b-48f7-af99-3205dfb6364c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:14:33.870974 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-314497ed-b07b-48f7-af99-3205dfb6364c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:33.871461 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-314497ed-b07b-48f7-af99-3205dfb6364c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:33.871929 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-314497ed-b07b-48f7-af99-3205dfb6364c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:33.872651 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-314497ed-b07b-48f7-af99-3205dfb6364c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:33.873093 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-314497ed-b07b-48f7-af99-3205dfb6364c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:33.873504 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-314497ed-b07b-48f7-af99-3205dfb6364c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:34.011223 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-314497ed-b07b-48f7-af99-3205dfb6364c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:34.020237 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-314497ed-b07b-48f7-af99-3205dfb6364c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:34.021700 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-314497ed-b07b-48f7-af99-3205dfb6364c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:34.022851 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-314497ed-b07b-48f7-af99-3205dfb6364c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1732 microversion: 2.20 time: 0.163618 Aug 31 13:14:34.023431 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 474/974] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:14:33 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:14:35.049805 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-38a70bce-7c7a-4ea4-8da1-c2e34031407e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:14:35.050797 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-38a70bce-7c7a-4ea4-8da1-c2e34031407e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:14:35.061726 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-38a70bce-7c7a-4ea4-8da1-c2e34031407e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:35.062519 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-38a70bce-7c7a-4ea4-8da1-c2e34031407e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:35.063323 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-38a70bce-7c7a-4ea4-8da1-c2e34031407e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:35.064053 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-38a70bce-7c7a-4ea4-8da1-c2e34031407e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:35.064500 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-38a70bce-7c7a-4ea4-8da1-c2e34031407e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:35.064915 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-38a70bce-7c7a-4ea4-8da1-c2e34031407e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:35.213691 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-38a70bce-7c7a-4ea4-8da1-c2e34031407e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:35.222576 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-38a70bce-7c7a-4ea4-8da1-c2e34031407e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:35.224076 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-38a70bce-7c7a-4ea4-8da1-c2e34031407e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:35.225256 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-38a70bce-7c7a-4ea4-8da1-c2e34031407e tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1732 microversion: 2.20 time: 0.182085 Aug 31 13:14:35.225829 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 501/975] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:14:35 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1732 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:14:36.252622 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-6ed8f738-d669-4f93-8b8e-cd922af99507 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:14:36.253472 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-6ed8f738-d669-4f93-8b8e-cd922af99507 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:14:36.264456 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6ed8f738-d669-4f93-8b8e-cd922af99507 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:36.265241 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6ed8f738-d669-4f93-8b8e-cd922af99507 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:36.265944 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6ed8f738-d669-4f93-8b8e-cd922af99507 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:36.266873 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6ed8f738-d669-4f93-8b8e-cd922af99507 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:36.267313 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6ed8f738-d669-4f93-8b8e-cd922af99507 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:36.267720 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6ed8f738-d669-4f93-8b8e-cd922af99507 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:36.418231 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-6ed8f738-d669-4f93-8b8e-cd922af99507 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:36.426942 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-6ed8f738-d669-4f93-8b8e-cd922af99507 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:36.428405 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-6ed8f738-d669-4f93-8b8e-cd922af99507 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:36.429557 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-6ed8f738-d669-4f93-8b8e-cd922af99507 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1732 microversion: 2.20 time: 0.184074 Aug 31 13:14:36.430132 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 475/976] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:14:36 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1732 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:14:37.453198 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-4a12a352-b66e-40ba-b641-a6030238f68c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:14:37.453782 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-4a12a352-b66e-40ba-b641-a6030238f68c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:14:37.460919 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4a12a352-b66e-40ba-b641-a6030238f68c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:37.461402 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4a12a352-b66e-40ba-b641-a6030238f68c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:37.462127 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4a12a352-b66e-40ba-b641-a6030238f68c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:37.462537 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4a12a352-b66e-40ba-b641-a6030238f68c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:37.462997 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4a12a352-b66e-40ba-b641-a6030238f68c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:37.463455 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4a12a352-b66e-40ba-b641-a6030238f68c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:37.489437 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-9dd8981e-dd08-4101-81dd-fabc936d3e58 req-4005fbf9-ec2f-4163-84c9-4e73d643d093 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b02d1346-91cf-4003-a5f4-8ae3e32d6e75", "name": "network-vif-plugged", "status": "completed", "tag": "51d49abf-a001-4e75-bc6f-08a55177cf60"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:14:37.500799 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-9dd8981e-dd08-4101-81dd-fabc936d3e58 req-4005fbf9-ec2f-4163-84c9-4e73d643d093 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:37.501311 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-9dd8981e-dd08-4101-81dd-fabc936d3e58 req-4005fbf9-ec2f-4163-84c9-4e73d643d093 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:37.501738 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-9dd8981e-dd08-4101-81dd-fabc936d3e58 req-4005fbf9-ec2f-4163-84c9-4e73d643d093 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:37.513777 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-9dd8981e-dd08-4101-81dd-fabc936d3e58 req-4005fbf9-ec2f-4163-84c9-4e73d643d093 service nova] Creating event network-vif-plugged:51d49abf-a001-4e75-bc6f-08a55177cf60 for instance b02d1346-91cf-4003-a5f4-8ae3e32d6e75 on hv-cinder-85442 Aug 31 13:14:37.519175 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-9dd8981e-dd08-4101-81dd-fabc936d3e58 req-4005fbf9-ec2f-4163-84c9-4e73d643d093 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033375 Aug 31 13:14:37.520112 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 476/977] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:14:37.600790 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-4a12a352-b66e-40ba-b641-a6030238f68c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:37.609147 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-4a12a352-b66e-40ba-b641-a6030238f68c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:37.610744 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-4a12a352-b66e-40ba-b641-a6030238f68c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:37.611981 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-4a12a352-b66e-40ba-b641-a6030238f68c tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1732 microversion: 2.20 time: 0.163347 Aug 31 13:14:37.612574 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 502/978] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:14:37 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:14:38.641156 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-00d462a4-4791-4319-a23b-4afb85a4e1c5 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:14:38.642180 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-00d462a4-4791-4319-a23b-4afb85a4e1c5 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:14:38.648952 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-00d462a4-4791-4319-a23b-4afb85a4e1c5 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:38.649450 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-00d462a4-4791-4319-a23b-4afb85a4e1c5 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:38.649860 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-00d462a4-4791-4319-a23b-4afb85a4e1c5 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:38.650579 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-00d462a4-4791-4319-a23b-4afb85a4e1c5 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:38.651022 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-00d462a4-4791-4319-a23b-4afb85a4e1c5 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:38.651442 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-00d462a4-4791-4319-a23b-4afb85a4e1c5 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:38.796228 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-00d462a4-4791-4319-a23b-4afb85a4e1c5 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:38.809810 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-00d462a4-4791-4319-a23b-4afb85a4e1c5 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:38.812169 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-00d462a4-4791-4319-a23b-4afb85a4e1c5 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:38.814101 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-00d462a4-4791-4319-a23b-4afb85a4e1c5 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1732 microversion: 2.20 time: 0.180575 Aug 31 13:14:38.814662 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 477/979] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:14:38 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1732 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:14:39.838539 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-c0f877e6-dfa1-4020-a6a3-6dfc91347eea tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:14:39.839876 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-c0f877e6-dfa1-4020-a6a3-6dfc91347eea tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:14:39.847287 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c0f877e6-dfa1-4020-a6a3-6dfc91347eea tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:39.847779 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c0f877e6-dfa1-4020-a6a3-6dfc91347eea tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:39.848236 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c0f877e6-dfa1-4020-a6a3-6dfc91347eea tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:39.848926 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c0f877e6-dfa1-4020-a6a3-6dfc91347eea tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:39.849377 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c0f877e6-dfa1-4020-a6a3-6dfc91347eea tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:39.849797 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c0f877e6-dfa1-4020-a6a3-6dfc91347eea tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:40.002677 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-c0f877e6-dfa1-4020-a6a3-6dfc91347eea tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:40.011862 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-c0f877e6-dfa1-4020-a6a3-6dfc91347eea tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:40.013371 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-c0f877e6-dfa1-4020-a6a3-6dfc91347eea tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:40.014583 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-c0f877e6-dfa1-4020-a6a3-6dfc91347eea tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1732 microversion: 2.20 time: 0.181263 Aug 31 13:14:40.015186 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 503/980] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:14:39 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1732 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:14:41.043610 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-de0ad9e3-b293-498a-8425-8c7786103967 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:14:41.044639 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-de0ad9e3-b293-498a-8425-8c7786103967 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:14:41.055580 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-de0ad9e3-b293-498a-8425-8c7786103967 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:41.056479 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-de0ad9e3-b293-498a-8425-8c7786103967 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:41.057198 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-de0ad9e3-b293-498a-8425-8c7786103967 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:41.058348 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-de0ad9e3-b293-498a-8425-8c7786103967 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:14:41.059094 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-de0ad9e3-b293-498a-8425-8c7786103967 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:14:41.060087 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-de0ad9e3-b293-498a-8425-8c7786103967 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:14:41.199310 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-de0ad9e3-b293-498a-8425-8c7786103967 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:41.208177 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-de0ad9e3-b293-498a-8425-8c7786103967 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:41.209611 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-de0ad9e3-b293-498a-8425-8c7786103967 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:14:41.210799 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-de0ad9e3-b293-498a-8425-8c7786103967 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1719 microversion: 2.20 time: 0.173899 Aug 31 13:14:41.211340 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 478/981] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:14:41 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1719 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:15:46.284119 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:15:46.284897 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:15:46.286035 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 13:15:46.286280 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Wed Aug 31 13:15:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75/os-volume_attachments (ip 10.222.0.58) !!! Aug 31 13:15:46.291829 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-b113a85c-fb24-4c91-a7ed-8ee37f9f3053 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:15:46.294166 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-b113a85c-fb24-4c91-a7ed-8ee37f9f3053 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:15:46.304490 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b113a85c-fb24-4c91-a7ed-8ee37f9f3053 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:15:46.304964 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b113a85c-fb24-4c91-a7ed-8ee37f9f3053 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:15:46.305392 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b113a85c-fb24-4c91-a7ed-8ee37f9f3053 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:15:46.306111 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b113a85c-fb24-4c91-a7ed-8ee37f9f3053 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:15:46.306554 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b113a85c-fb24-4c91-a7ed-8ee37f9f3053 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:15:46.306966 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b113a85c-fb24-4c91-a7ed-8ee37f9f3053 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:15:46.339278 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-b113a85c-fb24-4c91-a7ed-8ee37f9f3053 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.057370 Aug 31 13:15:46.339873 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 504/982] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 31 13:15:46 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:15:46.406330 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=27 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:15:46.407348 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:15:46.408919 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 13:15:46.409106 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Wed Aug 31 13:15:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 (ip 10.222.0.58) !!! Aug 31 13:15:46.410350 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 13:15:46.410491 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Wed Aug 31 13:15:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 (ip 10.222.0.58) !!! Aug 31 13:15:46.418486 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-8ceb0180-66c1-4fc3-91ac-22cc24ea39a0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:15:46.419209 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-8ceb0180-66c1-4fc3-91ac-22cc24ea39a0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:15:46.435123 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8ceb0180-66c1-4fc3-91ac-22cc24ea39a0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:15:46.435685 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8ceb0180-66c1-4fc3-91ac-22cc24ea39a0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:15:46.436147 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8ceb0180-66c1-4fc3-91ac-22cc24ea39a0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:15:46.438142 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8ceb0180-66c1-4fc3-91ac-22cc24ea39a0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:15:46.438142 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8ceb0180-66c1-4fc3-91ac-22cc24ea39a0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:15:46.438142 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8ceb0180-66c1-4fc3-91ac-22cc24ea39a0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:15:46.468200 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-8ceb0180-66c1-4fc3-91ac-22cc24ea39a0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Going to try to terminate instance {{(pid=120705) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 13:15:46.553660 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-8ceb0180-66c1-4fc3-91ac-22cc24ea39a0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 204 len: 0 microversion: 2.20 time: 0.150477 Aug 31 13:15:46.554466 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 479/983] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 31 13:15:46 2022] DELETE /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 13:15:46.565823 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-662746ae-ef48-4f75-8376-fb4bdb6beb54 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:15:46.566420 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-662746ae-ef48-4f75-8376-fb4bdb6beb54 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:15:46.572743 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-662746ae-ef48-4f75-8376-fb4bdb6beb54 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:15:46.573225 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-662746ae-ef48-4f75-8376-fb4bdb6beb54 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:15:46.573646 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-662746ae-ef48-4f75-8376-fb4bdb6beb54 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:15:46.574329 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-662746ae-ef48-4f75-8376-fb4bdb6beb54 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:15:46.574798 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-662746ae-ef48-4f75-8376-fb4bdb6beb54 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:15:46.575194 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-662746ae-ef48-4f75-8376-fb4bdb6beb54 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:15:46.711515 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-662746ae-ef48-4f75-8376-fb4bdb6beb54 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:15:46.722555 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-662746ae-ef48-4f75-8376-fb4bdb6beb54 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:15:46.723934 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-662746ae-ef48-4f75-8376-fb4bdb6beb54 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:15:46.725111 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-662746ae-ef48-4f75-8376-fb4bdb6beb54 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1725 microversion: 2.20 time: 0.163663 Aug 31 13:15:46.725831 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 505/984] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:15:46 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:15:47.752295 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-be2c5d4d-710a-474d-a605-ceb3b207cb7b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:15:47.753009 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-be2c5d4d-710a-474d-a605-ceb3b207cb7b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:15:47.760215 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-be2c5d4d-710a-474d-a605-ceb3b207cb7b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:15:47.760690 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-be2c5d4d-710a-474d-a605-ceb3b207cb7b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:15:47.761112 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-be2c5d4d-710a-474d-a605-ceb3b207cb7b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:15:47.761797 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-be2c5d4d-710a-474d-a605-ceb3b207cb7b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:15:47.762240 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-be2c5d4d-710a-474d-a605-ceb3b207cb7b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:15:47.762707 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-be2c5d4d-710a-474d-a605-ceb3b207cb7b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:15:47.910053 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-be2c5d4d-710a-474d-a605-ceb3b207cb7b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:15:47.918908 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-be2c5d4d-710a-474d-a605-ceb3b207cb7b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:15:47.920405 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-be2c5d4d-710a-474d-a605-ceb3b207cb7b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:15:47.921588 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-be2c5d4d-710a-474d-a605-ceb3b207cb7b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1725 microversion: 2.20 time: 0.176092 Aug 31 13:15:47.926208 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 480/985] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:15:47 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:15:48.945093 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-68773c75-53e0-42d8-8464-b2d02da803e7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:15:48.945852 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-68773c75-53e0-42d8-8464-b2d02da803e7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:15:48.952654 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-68773c75-53e0-42d8-8464-b2d02da803e7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:15:48.953121 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-68773c75-53e0-42d8-8464-b2d02da803e7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:15:48.953552 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-68773c75-53e0-42d8-8464-b2d02da803e7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:15:48.954260 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-68773c75-53e0-42d8-8464-b2d02da803e7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:15:48.954757 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-68773c75-53e0-42d8-8464-b2d02da803e7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:15:48.955273 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-68773c75-53e0-42d8-8464-b2d02da803e7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:15:49.086990 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-68773c75-53e0-42d8-8464-b2d02da803e7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:15:49.096027 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-68773c75-53e0-42d8-8464-b2d02da803e7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:15:49.097478 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-68773c75-53e0-42d8-8464-b2d02da803e7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:15:49.098671 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-68773c75-53e0-42d8-8464-b2d02da803e7 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1725 microversion: 2.20 time: 0.157819 Aug 31 13:15:49.099477 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 506/986] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:15:48 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:15:49.640102 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-0cb2cc01-0057-4f4f-bac4-ed049335bff5 req-316731d4-93e8-47b2-b183-12c92a773d6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b02d1346-91cf-4003-a5f4-8ae3e32d6e75", "name": "network-vif-deleted", "tag": "51d49abf-a001-4e75-bc6f-08a55177cf60"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:15:49.660194 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-0cb2cc01-0057-4f4f-bac4-ed049335bff5 req-316731d4-93e8-47b2-b183-12c92a773d6e service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:15:49.660708 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-0cb2cc01-0057-4f4f-bac4-ed049335bff5 req-316731d4-93e8-47b2-b183-12c92a773d6e service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:15:49.661183 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-0cb2cc01-0057-4f4f-bac4-ed049335bff5 req-316731d4-93e8-47b2-b183-12c92a773d6e service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:15:49.673563 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-0cb2cc01-0057-4f4f-bac4-ed049335bff5 req-316731d4-93e8-47b2-b183-12c92a773d6e service nova] Creating event network-vif-deleted:51d49abf-a001-4e75-bc6f-08a55177cf60 for instance b02d1346-91cf-4003-a5f4-8ae3e32d6e75 on hv-cinder-85442 Aug 31 13:15:49.679628 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-0cb2cc01-0057-4f4f-bac4-ed049335bff5 req-316731d4-93e8-47b2-b183-12c92a773d6e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142281 Aug 31 13:15:49.681023 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 481/987] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:15:50.122627 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-b9a20980-d9ff-4a1a-bcef-5cb9f6a5e9d5 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:15:50.124440 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-b9a20980-d9ff-4a1a-bcef-5cb9f6a5e9d5 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:15:50.133033 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b9a20980-d9ff-4a1a-bcef-5cb9f6a5e9d5 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:15:50.133535 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b9a20980-d9ff-4a1a-bcef-5cb9f6a5e9d5 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:15:50.134199 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b9a20980-d9ff-4a1a-bcef-5cb9f6a5e9d5 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:15:50.134887 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b9a20980-d9ff-4a1a-bcef-5cb9f6a5e9d5 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:15:50.135331 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b9a20980-d9ff-4a1a-bcef-5cb9f6a5e9d5 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:15:50.135754 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b9a20980-d9ff-4a1a-bcef-5cb9f6a5e9d5 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:15:50.170248 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b9a20980-d9ff-4a1a-bcef-5cb9f6a5e9d5 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:15:50.170728 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b9a20980-d9ff-4a1a-bcef-5cb9f6a5e9d5 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:15:50.171159 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b9a20980-d9ff-4a1a-bcef-5cb9f6a5e9d5 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:15:50.171606 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.objects.instance [None req-b9a20980-d9ff-4a1a-bcef-5cb9f6a5e9d5 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lazy-loading 'fault' on Instance uuid b02d1346-91cf-4003-a5f4-8ae3e32d6e75 {{(pid=120704) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 13:15:50.216622 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-b9a20980-d9ff-4a1a-bcef-5cb9f6a5e9d5 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:15:50.226191 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-b9a20980-d9ff-4a1a-bcef-5cb9f6a5e9d5 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:15:50.227764 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-b9a20980-d9ff-4a1a-bcef-5cb9f6a5e9d5 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb16ef11b3a9482ab5d40ff98ebd9cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed24957ab734181bca8793a33f63645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:15:50.229231 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-b9a20980-d9ff-4a1a-bcef-5cb9f6a5e9d5 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 200 len: 1372 microversion: 2.20 time: 0.111164 Aug 31 13:15:50.229816 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 507/988] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:15:50 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 1372 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:15:51.258751 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-a143483a-64f9-478d-983a-859f0f6124b8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:15:51.259770 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-a143483a-64f9-478d-983a-859f0f6124b8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:15:51.271046 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a143483a-64f9-478d-983a-859f0f6124b8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:15:51.271887 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a143483a-64f9-478d-983a-859f0f6124b8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:15:51.272604 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a143483a-64f9-478d-983a-859f0f6124b8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:15:51.273891 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a143483a-64f9-478d-983a-859f0f6124b8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:15:51.274625 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a143483a-64f9-478d-983a-859f0f6124b8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:15:51.275315 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a143483a-64f9-478d-983a-859f0f6124b8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:15:51.292870 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-a143483a-64f9-478d-983a-859f0f6124b8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] HTTP exception thrown: Instance b02d1346-91cf-4003-a5f4-8ae3e32d6e75 could not be found. Aug 31 13:15:51.294455 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-a143483a-64f9-478d-983a-859f0f6124b8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Request method failure captured: Aug 31 13:15:51.294455 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: request: GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 HTTP/1.1 Aug 31 13:15:51.294455 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 31 13:15:51.294455 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 31 13:15:51.294455 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Connection: close Aug 31 13:15:51.294455 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 31 13:15:51.294455 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 31 13:15:51.294455 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Host: 10.222.0.58 Aug 31 13:15:51.294455 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 31 13:15:51.294455 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 31 13:15:51.294455 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjD10V1pDy8vLsqU7eN4fBfkHumRYncrASgxbQHDwed3X-qzRV4BOn7bS7unBc59JyrqzfyOD42czlJn_CS32tzMZE6Eh9BfiiBTBwp_THEAnwuUBDSc2IU0zCJArqiQPh1wS5An3C9vT4PAKjtvZTjsWe0BQIj0MiiPhoEoxdaruYlcU Aug 31 13:15:51.294455 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 31 13:15:51.294455 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 31 13:15:51.294455 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 31 13:15:51.294455 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 31 13:15:51.294455 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 13:15:51.294455 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 31 13:15:51.294455 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 31 13:15:51.294455 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Id: 8ed24957ab734181bca8793a33f63645 Aug 31 13:15:51.294455 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1938781708 Aug 31 13:15:51.294455 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Role: member,reader Aug 31 13:15:51.294455 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Roles: member,reader Aug 31 13:15:51.296278 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8ed24957ab734181bca8793a33f63645"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8ed24957ab734181bca8793a33f63645"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8ed24957ab734181bca8793a33f63645"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8ed24957ab734181bca8793a33f63645"}]}] Aug 31 13:15:51.296278 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1938781708 Aug 31 13:15:51.296278 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant-Id: 8ed24957ab734181bca8793a33f63645 Aug 31 13:15:51.296278 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1938781708 Aug 31 13:15:51.296278 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User: tempest-AttachVolumeShelveTestJSON-1938781708-project Aug 31 13:15:51.296278 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 31 13:15:51.296278 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 31 13:15:51.296278 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Id: fb16ef11b3a9482ab5d40ff98ebd9cae Aug 31 13:15:51.296278 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1938781708-project Aug 31 13:15:51.296278 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: method: > Aug 31 13:15:51.296278 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: exception: Instance b02d1346-91cf-4003-a5f4-8ae3e32d6e75 could not be found. Aug 31 13:15:51.296278 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: action_args: {'id': 'b02d1346-91cf-4003-a5f4-8ae3e32d6e75'} Aug 31 13:15:51.297412 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:15:51.297412 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:15:51.297412 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 13:15:51.297412 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 13:15:51.297412 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 13:15:51.297412 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 13:15:51.297412 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 13:15:51.297412 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 13:15:51.297412 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 13:15:51.297412 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 13:15:51.297412 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b02d1346-91cf-4003-a5f4-8ae3e32d6e75 could not be found. Aug 31 13:15:51.297412 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:15:51.297412 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:15:51.297412 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:15:51.297412 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:15:51.297412 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:15:51.297412 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:15:51.297412 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:15:51.297412 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:15:51.297412 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:15:51.299031 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:15:51.299031 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 13:15:51.299031 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 13:15:51.299031 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 13:15:51.299031 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 13:15:51.299031 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 13:15:51.299031 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 13:15:51.299031 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b02d1346-91cf-4003-a5f4-8ae3e32d6e75 could not be found. Aug 31 13:15:51.299031 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:15:51.299031 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:15:51.299031 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:15:51.299031 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:15:51.299031 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:15:51.299031 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:15:51.299031 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:15:51.299031 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:15:51.299031 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b02d1346-91cf-4003-a5f4-8ae3e32d6e75 could not be found. Aug 31 13:15:51.299031 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:15:51.300521 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-a143483a-64f9-478d-983a-859f0f6124b8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Returning 404 to user: Instance b02d1346-91cf-4003-a5f4-8ae3e32d6e75 could not be found. {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:15:51.300521 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-a143483a-64f9-478d-983a-859f0f6124b8 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 404 len: 111 microversion: 2.20 time: 0.045046 Aug 31 13:15:51.300521 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 482/989] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:15:51 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 13:15:51.304874 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-ecb6f12e-2369-45d8-86ec-b4044801859b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '.version_select at 0x7f19513c3940>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:15:51.331387 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-ecb6f12e-2369-45d8-86ec-b4044801859b tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1271131285" status: 204 len: 0 microversion: 2.20 time: 0.030392 Aug 31 13:15:51.332007 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 508/990] 10.222.0.58 () {60 vars in 1262 bytes} [Wed Aug 31 13:15:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1271131285 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 13:15:53.146083 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-00de43ff-05fd-408a-8af1-56a5476a13aa tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:15:53.146588 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-00de43ff-05fd-408a-8af1-56a5476a13aa tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:15:53.153570 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-00de43ff-05fd-408a-8af1-56a5476a13aa tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:15:53.154055 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-00de43ff-05fd-408a-8af1-56a5476a13aa tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:15:53.154486 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-00de43ff-05fd-408a-8af1-56a5476a13aa tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:15:53.155512 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-00de43ff-05fd-408a-8af1-56a5476a13aa tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:15:53.155992 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-00de43ff-05fd-408a-8af1-56a5476a13aa tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:15:53.156421 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-00de43ff-05fd-408a-8af1-56a5476a13aa tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:15:53.172411 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-00de43ff-05fd-408a-8af1-56a5476a13aa tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] HTTP exception thrown: Instance b02d1346-91cf-4003-a5f4-8ae3e32d6e75 could not be found. Aug 31 13:15:53.173951 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-00de43ff-05fd-408a-8af1-56a5476a13aa tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Request method failure captured: Aug 31 13:15:53.173951 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: request: DELETE /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 HTTP/1.1 Aug 31 13:15:53.173951 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 31 13:15:53.173951 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 31 13:15:53.173951 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Connection: close Aug 31 13:15:53.173951 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 31 13:15:53.173951 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 31 13:15:53.173951 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Host: 10.222.0.58 Aug 31 13:15:53.173951 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 31 13:15:53.173951 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 31 13:15:53.173951 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjD10V1pDy8vLsqU7eN4fBfkHumRYncrASgxbQHDwed3X-qzRV4BOn7bS7unBc59JyrqzfyOD42czlJn_CS32tzMZE6Eh9BfiiBTBwp_THEAnwuUBDSc2IU0zCJArqiQPh1wS5An3C9vT4PAKjtvZTjsWe0BQIj0MiiPhoEoxdaruYlcU Aug 31 13:15:53.173951 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 31 13:15:53.173951 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 31 13:15:53.173951 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 31 13:15:53.173951 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 31 13:15:53.173951 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 13:15:53.173951 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 31 13:15:53.173951 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 31 13:15:53.173951 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Id: 8ed24957ab734181bca8793a33f63645 Aug 31 13:15:53.173951 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1938781708 Aug 31 13:15:53.173951 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Role: member,reader Aug 31 13:15:53.173951 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Roles: member,reader Aug 31 13:15:53.177756 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8ed24957ab734181bca8793a33f63645"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8ed24957ab734181bca8793a33f63645"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8ed24957ab734181bca8793a33f63645"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8ed24957ab734181bca8793a33f63645"}]}] Aug 31 13:15:53.177756 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1938781708 Aug 31 13:15:53.177756 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant-Id: 8ed24957ab734181bca8793a33f63645 Aug 31 13:15:53.177756 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1938781708 Aug 31 13:15:53.177756 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User: tempest-AttachVolumeShelveTestJSON-1938781708-project Aug 31 13:15:53.177756 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 31 13:15:53.177756 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 31 13:15:53.177756 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Id: fb16ef11b3a9482ab5d40ff98ebd9cae Aug 31 13:15:53.177756 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1938781708-project Aug 31 13:15:53.177756 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: method: > Aug 31 13:15:53.177756 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: exception: Instance b02d1346-91cf-4003-a5f4-8ae3e32d6e75 could not be found. Aug 31 13:15:53.177756 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: action_args: {'id': 'b02d1346-91cf-4003-a5f4-8ae3e32d6e75'} Aug 31 13:15:53.178645 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:15:53.178645 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:15:53.178645 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 13:15:53.178645 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 13:15:53.178645 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 13:15:53.178645 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 13:15:53.178645 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 13:15:53.178645 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 13:15:53.178645 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 13:15:53.178645 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 13:15:53.178645 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b02d1346-91cf-4003-a5f4-8ae3e32d6e75 could not be found. Aug 31 13:15:53.178645 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:15:53.178645 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:15:53.178645 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:15:53.178645 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:15:53.178645 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:15:53.178645 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:15:53.178645 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:15:53.178645 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:15:53.178645 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:15:53.180151 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:15:53.180151 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 13:15:53.180151 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 13:15:53.180151 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 13:15:53.180151 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 13:15:53.180151 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 13:15:53.180151 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 13:15:53.180151 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 13:15:53.180151 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 13:15:53.180151 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b02d1346-91cf-4003-a5f4-8ae3e32d6e75 could not be found. Aug 31 13:15:53.180151 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:15:53.180151 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:15:53.180151 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:15:53.180151 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:15:53.180151 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:15:53.180151 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:15:53.180151 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:15:53.180151 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:15:53.180151 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b02d1346-91cf-4003-a5f4-8ae3e32d6e75 could not be found. Aug 31 13:15:53.180151 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:15:53.181635 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-00de43ff-05fd-408a-8af1-56a5476a13aa tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Returning 404 to user: Instance b02d1346-91cf-4003-a5f4-8ae3e32d6e75 could not be found. {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:15:53.181635 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-00de43ff-05fd-408a-8af1-56a5476a13aa tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 404 len: 111 microversion: 2.20 time: 0.033398 Aug 31 13:15:53.181635 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 483/991] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 31 13:15:53 2022] DELETE /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 13:15:53.185877 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-14538d3f-1fab-478b-9ca5-15723d1f65bb tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:15:53.186595 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-14538d3f-1fab-478b-9ca5-15723d1f65bb tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: b02d1346-91cf-4003-a5f4-8ae3e32d6e75] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:15:53.197213 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-14538d3f-1fab-478b-9ca5-15723d1f65bb tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:15:53.197791 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-14538d3f-1fab-478b-9ca5-15723d1f65bb tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:15:53.198421 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-14538d3f-1fab-478b-9ca5-15723d1f65bb tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:15:53.199461 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-14538d3f-1fab-478b-9ca5-15723d1f65bb tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:15:53.200174 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-14538d3f-1fab-478b-9ca5-15723d1f65bb tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:15:53.200792 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-14538d3f-1fab-478b-9ca5-15723d1f65bb tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:15:53.216111 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.wsgi [None req-14538d3f-1fab-478b-9ca5-15723d1f65bb tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] HTTP exception thrown: Instance b02d1346-91cf-4003-a5f4-8ae3e32d6e75 could not be found. Aug 31 13:15:53.217803 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-14538d3f-1fab-478b-9ca5-15723d1f65bb tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Request method failure captured: Aug 31 13:15:53.217803 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: request: GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 HTTP/1.1 Aug 31 13:15:53.217803 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept: application/json Aug 31 13:15:53.217803 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept-Encoding: identity Aug 31 13:15:53.217803 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Connection: close Aug 31 13:15:53.217803 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Length: 0 Aug 31 13:15:53.217803 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Type: application/json Aug 31 13:15:53.217803 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Host: 10.222.0.58 Aug 31 13:15:53.217803 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Openstack-System-Scope: None Aug 31 13:15:53.217803 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: User-Agent: python-urllib3/1.26.12 Aug 31 13:15:53.217803 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Auth-Token: gAAAAABjD10V1pDy8vLsqU7eN4fBfkHumRYncrASgxbQHDwed3X-qzRV4BOn7bS7unBc59JyrqzfyOD42czlJn_CS32tzMZE6Eh9BfiiBTBwp_THEAnwuUBDSc2IU0zCJArqiQPh1wS5An3C9vT4PAKjtvZTjsWe0BQIj0MiiPhoEoxdaruYlcU Aug 31 13:15:53.217803 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Id: None Aug 31 13:15:53.217803 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Name: None Aug 31 13:15:53.217803 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Identity-Status: Confirmed Aug 31 13:15:53.217803 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Is-Admin-Project: True Aug 31 13:15:53.217803 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 13:15:53.217803 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Id: default Aug 31 13:15:53.217803 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Name: Default Aug 31 13:15:53.217803 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Id: 8ed24957ab734181bca8793a33f63645 Aug 31 13:15:53.217803 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1938781708 Aug 31 13:15:53.217803 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Role: member,reader Aug 31 13:15:53.217803 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Roles: member,reader Aug 31 13:15:53.219487 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8ed24957ab734181bca8793a33f63645"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8ed24957ab734181bca8793a33f63645"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8ed24957ab734181bca8793a33f63645"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8ed24957ab734181bca8793a33f63645"}]}] Aug 31 13:15:53.219487 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1938781708 Aug 31 13:15:53.219487 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Id: 8ed24957ab734181bca8793a33f63645 Aug 31 13:15:53.219487 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1938781708 Aug 31 13:15:53.219487 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User: tempest-AttachVolumeShelveTestJSON-1938781708-project Aug 31 13:15:53.219487 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Id: default Aug 31 13:15:53.219487 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Name: Default Aug 31 13:15:53.219487 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Id: fb16ef11b3a9482ab5d40ff98ebd9cae Aug 31 13:15:53.219487 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1938781708-project Aug 31 13:15:53.219487 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: method: > Aug 31 13:15:53.219487 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: exception: Instance b02d1346-91cf-4003-a5f4-8ae3e32d6e75 could not be found. Aug 31 13:15:53.219487 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: action_args: {'id': 'b02d1346-91cf-4003-a5f4-8ae3e32d6e75'} Aug 31 13:15:53.220431 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:15:53.220431 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:15:53.220431 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 13:15:53.220431 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 13:15:53.220431 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 13:15:53.220431 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 13:15:53.220431 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 13:15:53.220431 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 13:15:53.220431 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 13:15:53.220431 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 13:15:53.220431 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b02d1346-91cf-4003-a5f4-8ae3e32d6e75 could not be found. Aug 31 13:15:53.220431 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:15:53.220431 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:15:53.220431 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:15:53.220431 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:15:53.220431 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:15:53.220431 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:15:53.220431 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:15:53.220431 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:15:53.220431 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:15:53.221911 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:15:53.221911 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 13:15:53.221911 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 13:15:53.221911 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 13:15:53.221911 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 13:15:53.221911 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 13:15:53.221911 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 13:15:53.221911 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b02d1346-91cf-4003-a5f4-8ae3e32d6e75 could not be found. Aug 31 13:15:53.221911 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:15:53.221911 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:15:53.221911 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:15:53.221911 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:15:53.221911 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:15:53.221911 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:15:53.221911 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:15:53.221911 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:15:53.221911 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b02d1346-91cf-4003-a5f4-8ae3e32d6e75 could not be found. Aug 31 13:15:53.221911 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:15:53.223229 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-14538d3f-1fab-478b-9ca5-15723d1f65bb tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Returning 404 to user: Instance b02d1346-91cf-4003-a5f4-8ae3e32d6e75 could not be found. {{(pid=120704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:15:53.223229 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-14538d3f-1fab-478b-9ca5-15723d1f65bb tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75" status: 404 len: 111 microversion: 2.20 time: 0.038873 Aug 31 13:15:53.223229 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 509/992] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:15:53 2022] GET /compute/v2.1/servers/b02d1346-91cf-4003-a5f4-8ae3e32d6e75 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 13:15:54.366771 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-49a15acd-d58c-4791-8587-8b78189593c0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:15:54.367267 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-49a15acd-d58c-4791-8587-8b78189593c0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:15:54.374321 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-49a15acd-d58c-4791-8587-8b78189593c0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:15:54.374799 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-49a15acd-d58c-4791-8587-8b78189593c0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:15:54.375202 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-49a15acd-d58c-4791-8587-8b78189593c0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:15:54.376240 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-49a15acd-d58c-4791-8587-8b78189593c0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:15:54.376687 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-49a15acd-d58c-4791-8587-8b78189593c0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:15:54.377111 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-49a15acd-d58c-4791-8587-8b78189593c0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:15:54.391022 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-49a15acd-d58c-4791-8587-8b78189593c0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] HTTP exception thrown: Instance 21c9e3cb-e5b1-428d-8405-ec33632c5f3d could not be found. Aug 31 13:15:54.392628 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-49a15acd-d58c-4791-8587-8b78189593c0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Request method failure captured: Aug 31 13:15:54.392628 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: request: DELETE /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d HTTP/1.1 Aug 31 13:15:54.392628 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 31 13:15:54.392628 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 31 13:15:54.392628 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Connection: close Aug 31 13:15:54.392628 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 31 13:15:54.392628 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 31 13:15:54.392628 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Host: 10.222.0.58 Aug 31 13:15:54.392628 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 31 13:15:54.392628 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 31 13:15:54.392628 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjD10V1pDy8vLsqU7eN4fBfkHumRYncrASgxbQHDwed3X-qzRV4BOn7bS7unBc59JyrqzfyOD42czlJn_CS32tzMZE6Eh9BfiiBTBwp_THEAnwuUBDSc2IU0zCJArqiQPh1wS5An3C9vT4PAKjtvZTjsWe0BQIj0MiiPhoEoxdaruYlcU Aug 31 13:15:54.392628 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 31 13:15:54.392628 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 31 13:15:54.392628 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 31 13:15:54.392628 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 31 13:15:54.392628 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 13:15:54.392628 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 31 13:15:54.392628 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 31 13:15:54.392628 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Id: 8ed24957ab734181bca8793a33f63645 Aug 31 13:15:54.392628 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1938781708 Aug 31 13:15:54.392628 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Role: member,reader Aug 31 13:15:54.392628 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Roles: member,reader Aug 31 13:15:54.394117 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8ed24957ab734181bca8793a33f63645"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8ed24957ab734181bca8793a33f63645"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8ed24957ab734181bca8793a33f63645"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8ed24957ab734181bca8793a33f63645"}]}] Aug 31 13:15:54.394117 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1938781708 Aug 31 13:15:54.394117 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant-Id: 8ed24957ab734181bca8793a33f63645 Aug 31 13:15:54.394117 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1938781708 Aug 31 13:15:54.394117 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User: tempest-AttachVolumeShelveTestJSON-1938781708-project Aug 31 13:15:54.394117 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 31 13:15:54.394117 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 31 13:15:54.394117 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Id: fb16ef11b3a9482ab5d40ff98ebd9cae Aug 31 13:15:54.394117 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1938781708-project Aug 31 13:15:54.394117 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: method: > Aug 31 13:15:54.394117 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: exception: Instance 21c9e3cb-e5b1-428d-8405-ec33632c5f3d could not be found. Aug 31 13:15:54.394117 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: action_args: {'id': '21c9e3cb-e5b1-428d-8405-ec33632c5f3d'} Aug 31 13:15:54.394968 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:15:54.394968 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:15:54.394968 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 13:15:54.394968 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 13:15:54.394968 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 13:15:54.394968 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 13:15:54.394968 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 13:15:54.394968 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 13:15:54.394968 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 13:15:54.394968 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 13:15:54.394968 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21c9e3cb-e5b1-428d-8405-ec33632c5f3d could not be found. Aug 31 13:15:54.394968 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:15:54.394968 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:15:54.394968 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:15:54.394968 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:15:54.394968 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:15:54.394968 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:15:54.394968 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:15:54.394968 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:15:54.394968 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:15:54.396714 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:15:54.396714 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 13:15:54.396714 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 13:15:54.396714 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 13:15:54.396714 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 13:15:54.396714 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 13:15:54.396714 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 13:15:54.396714 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 13:15:54.396714 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 13:15:54.396714 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21c9e3cb-e5b1-428d-8405-ec33632c5f3d could not be found. Aug 31 13:15:54.396714 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:15:54.396714 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:15:54.396714 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:15:54.396714 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:15:54.396714 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:15:54.396714 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:15:54.396714 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:15:54.396714 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:15:54.396714 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21c9e3cb-e5b1-428d-8405-ec33632c5f3d could not be found. Aug 31 13:15:54.396714 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:15:54.398621 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-49a15acd-d58c-4791-8587-8b78189593c0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Returning 404 to user: Instance 21c9e3cb-e5b1-428d-8405-ec33632c5f3d could not be found. {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:15:54.398621 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-49a15acd-d58c-4791-8587-8b78189593c0 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "DELETE /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 404 len: 111 microversion: 2.20 time: 0.031274 Aug 31 13:15:54.398621 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 484/993] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 31 13:15:54 2022] DELETE /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 13:15:54.403675 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-df2421d0-8a1a-451f-96db-5e7f22ecc878 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:15:54.404284 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-df2421d0-8a1a-451f-96db-5e7f22ecc878 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] [instance: 21c9e3cb-e5b1-428d-8405-ec33632c5f3d] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:15:54.411340 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-df2421d0-8a1a-451f-96db-5e7f22ecc878 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:15:54.411836 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-df2421d0-8a1a-451f-96db-5e7f22ecc878 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:15:54.412257 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-df2421d0-8a1a-451f-96db-5e7f22ecc878 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:15:54.413067 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-df2421d0-8a1a-451f-96db-5e7f22ecc878 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:15:54.413533 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-df2421d0-8a1a-451f-96db-5e7f22ecc878 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:15:54.413949 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-df2421d0-8a1a-451f-96db-5e7f22ecc878 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:15:54.427403 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.wsgi [None req-df2421d0-8a1a-451f-96db-5e7f22ecc878 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] HTTP exception thrown: Instance 21c9e3cb-e5b1-428d-8405-ec33632c5f3d could not be found. Aug 31 13:15:54.429127 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-df2421d0-8a1a-451f-96db-5e7f22ecc878 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Request method failure captured: Aug 31 13:15:54.429127 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: request: GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d HTTP/1.1 Aug 31 13:15:54.429127 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept: application/json Aug 31 13:15:54.429127 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept-Encoding: identity Aug 31 13:15:54.429127 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Connection: close Aug 31 13:15:54.429127 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Length: 0 Aug 31 13:15:54.429127 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Type: application/json Aug 31 13:15:54.429127 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Host: 10.222.0.58 Aug 31 13:15:54.429127 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Openstack-System-Scope: None Aug 31 13:15:54.429127 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: User-Agent: python-urllib3/1.26.12 Aug 31 13:15:54.429127 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Auth-Token: gAAAAABjD10V1pDy8vLsqU7eN4fBfkHumRYncrASgxbQHDwed3X-qzRV4BOn7bS7unBc59JyrqzfyOD42czlJn_CS32tzMZE6Eh9BfiiBTBwp_THEAnwuUBDSc2IU0zCJArqiQPh1wS5An3C9vT4PAKjtvZTjsWe0BQIj0MiiPhoEoxdaruYlcU Aug 31 13:15:54.429127 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Id: None Aug 31 13:15:54.429127 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Name: None Aug 31 13:15:54.429127 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Identity-Status: Confirmed Aug 31 13:15:54.429127 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Is-Admin-Project: True Aug 31 13:15:54.429127 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 13:15:54.429127 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Id: default Aug 31 13:15:54.429127 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Name: Default Aug 31 13:15:54.429127 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Id: 8ed24957ab734181bca8793a33f63645 Aug 31 13:15:54.429127 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1938781708 Aug 31 13:15:54.429127 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Role: member,reader Aug 31 13:15:54.429127 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Roles: member,reader Aug 31 13:15:54.430779 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8ed24957ab734181bca8793a33f63645"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8ed24957ab734181bca8793a33f63645"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8ed24957ab734181bca8793a33f63645"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8ed24957ab734181bca8793a33f63645"}]}] Aug 31 13:15:54.430779 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1938781708 Aug 31 13:15:54.430779 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Id: 8ed24957ab734181bca8793a33f63645 Aug 31 13:15:54.430779 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1938781708 Aug 31 13:15:54.430779 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User: tempest-AttachVolumeShelveTestJSON-1938781708-project Aug 31 13:15:54.430779 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Id: default Aug 31 13:15:54.430779 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Name: Default Aug 31 13:15:54.430779 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Id: fb16ef11b3a9482ab5d40ff98ebd9cae Aug 31 13:15:54.430779 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1938781708-project Aug 31 13:15:54.430779 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: method: > Aug 31 13:15:54.430779 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: exception: Instance 21c9e3cb-e5b1-428d-8405-ec33632c5f3d could not be found. Aug 31 13:15:54.430779 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: action_args: {'id': '21c9e3cb-e5b1-428d-8405-ec33632c5f3d'} Aug 31 13:15:54.431688 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:15:54.431688 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:15:54.431688 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 13:15:54.431688 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 13:15:54.431688 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 13:15:54.431688 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 13:15:54.431688 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 13:15:54.431688 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 13:15:54.431688 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 13:15:54.431688 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 13:15:54.431688 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21c9e3cb-e5b1-428d-8405-ec33632c5f3d could not be found. Aug 31 13:15:54.431688 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:15:54.431688 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:15:54.431688 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:15:54.431688 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:15:54.431688 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:15:54.431688 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:15:54.431688 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:15:54.431688 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:15:54.431688 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:15:54.433169 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:15:54.433169 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 13:15:54.433169 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 13:15:54.433169 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 13:15:54.433169 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 13:15:54.433169 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 13:15:54.433169 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 13:15:54.433169 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21c9e3cb-e5b1-428d-8405-ec33632c5f3d could not be found. Aug 31 13:15:54.433169 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:15:54.433169 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:15:54.433169 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:15:54.433169 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:15:54.433169 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:15:54.433169 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:15:54.433169 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:15:54.433169 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:15:54.433169 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21c9e3cb-e5b1-428d-8405-ec33632c5f3d could not be found. Aug 31 13:15:54.433169 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:15:54.434620 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-df2421d0-8a1a-451f-96db-5e7f22ecc878 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] Returning 404 to user: Instance 21c9e3cb-e5b1-428d-8405-ec33632c5f3d could not be found. {{(pid=120704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:15:54.434620 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-df2421d0-8a1a-451f-96db-5e7f22ecc878 tempest-AttachVolumeShelveTestJSON-1938781708 tempest-AttachVolumeShelveTestJSON-1938781708-project] 10.222.0.58 "GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d" status: 404 len: 111 microversion: 2.20 time: 0.031465 Aug 31 13:15:54.434620 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 510/994] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 31 13:15:54 2022] GET /compute/v2.1/servers/21c9e3cb-e5b1-428d-8405-ec33632c5f3d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 13:16:15.418727 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-134379f2-410e-48f3-93a7-e26f4ce0ef23 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-550588117", "imageRef": "2aa55919-0f25-4e84-a2e1-f60acbe208b2", "flavorRef": "452", "networks": [{"uuid": "4a9138c0-aaa9-43ac-a4e7-cef6c4a42b05"}]}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:16:15.427520 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:16:15.428181 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:16:15.478481 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.network.neutron [None req-134379f2-410e-48f3-93a7-e26f4ce0ef23 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] validate_networks() for [('4a9138c0-aaa9-43ac-a4e7-cef6c4a42b05', None, None, None, None, None)] {{(pid=120705) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 13:16:15.837551 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-134379f2-410e-48f3-93a7-e26f4ce0ef23 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Flavor limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 13:16:15.838038 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-134379f2-410e-48f3-93a7-e26f4ce0ef23 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Image limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 13:16:15.838510 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-134379f2-410e-48f3-93a7-e26f4ce0ef23 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Flavor pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 13:16:15.838909 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-134379f2-410e-48f3-93a7-e26f4ce0ef23 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Image pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 13:16:15.839317 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-134379f2-410e-48f3-93a7-e26f4ce0ef23 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 13:16:15.849719 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-134379f2-410e-48f3-93a7-e26f4ce0ef23 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:15.850131 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-134379f2-410e-48f3-93a7-e26f4ce0ef23 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:15.850563 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-134379f2-410e-48f3-93a7-e26f4ce0ef23 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:15.851280 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-134379f2-410e-48f3-93a7-e26f4ce0ef23 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:15.851731 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-134379f2-410e-48f3-93a7-e26f4ce0ef23 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:15.852180 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-134379f2-410e-48f3-93a7-e26f4ce0ef23 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:15.869078 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-134379f2-410e-48f3-93a7-e26f4ce0ef23 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Getting quotas for project efa652e067e840f1a4fee76614648726. Resources: {'instances', 'ram', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 13:16:15.873515 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-134379f2-410e-48f3-93a7-e26f4ce0ef23 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Getting quotas for user be2d237fbcac466cadbccce06ab883b6 and project efa652e067e840f1a4fee76614648726. Resources: {'instances', 'ram', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 13:16:15.885543 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-134379f2-410e-48f3-93a7-e26f4ce0ef23 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Going to run 1 instances... {{(pid=120705) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 13:16:15.887791 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-134379f2-410e-48f3-93a7-e26f4ce0ef23 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] [instance: d192f841-e952-4ba1-8e82-f8cee534ae44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2aa55919-0f25-4e84-a2e1-f60acbe208b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120705) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 13:16:15.936132 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-134379f2-410e-48f3-93a7-e26f4ce0ef23 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.521062 Aug 31 13:16:15.939707 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 485/995] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 31 13:16:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 13:16:15.944786 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:16:15.945571 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell1:SELECT=30 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:16:15.950156 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-4df4973f-c7c1-42e1-93a6-b2e4727be055 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:16:15.952004 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-4df4973f-c7c1-42e1-93a6-b2e4727be055 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] [instance: d192f841-e952-4ba1-8e82-f8cee534ae44] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:16:16.017899 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-4df4973f-c7c1-42e1-93a6-b2e4727be055 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d237fbcac466cadbccce06ab883b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa652e067e840f1a4fee76614648726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:16:16.026290 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-4df4973f-c7c1-42e1-93a6-b2e4727be055 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] 10.222.0.58 "GET /compute/v2.1/servers/d192f841-e952-4ba1-8e82-f8cee534ae44" status: 200 len: 1213 microversion: 2.1 time: 0.082567 Aug 31 13:16:16.026984 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 511/996] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:16:15 2022] GET /compute/v2.1/servers/d192f841-e952-4ba1-8e82-f8cee534ae44 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:16:17.052821 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-2557bfc5-f9e1-411a-b2dd-411f3bf0d61a tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:16:17.053446 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-2557bfc5-f9e1-411a-b2dd-411f3bf0d61a tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] [instance: d192f841-e952-4ba1-8e82-f8cee534ae44] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:16:17.060480 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2557bfc5-f9e1-411a-b2dd-411f3bf0d61a tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:17.060958 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2557bfc5-f9e1-411a-b2dd-411f3bf0d61a tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:17.061397 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2557bfc5-f9e1-411a-b2dd-411f3bf0d61a tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:17.062088 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2557bfc5-f9e1-411a-b2dd-411f3bf0d61a tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:17.062537 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2557bfc5-f9e1-411a-b2dd-411f3bf0d61a tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:17.062963 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2557bfc5-f9e1-411a-b2dd-411f3bf0d61a tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:17.125516 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-2557bfc5-f9e1-411a-b2dd-411f3bf0d61a tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d237fbcac466cadbccce06ab883b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa652e067e840f1a4fee76614648726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:16:17.133642 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-2557bfc5-f9e1-411a-b2dd-411f3bf0d61a tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] 10.222.0.58 "GET /compute/v2.1/servers/d192f841-e952-4ba1-8e82-f8cee534ae44" status: 200 len: 1265 microversion: 2.1 time: 0.088311 Aug 31 13:16:17.134206 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 486/997] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:16:17 2022] GET /compute/v2.1/servers/d192f841-e952-4ba1-8e82-f8cee534ae44 => generated 1265 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:16:18.155475 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-3a35fc54-f1be-4767-8553-48affafd1b75 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:16:18.156124 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-3a35fc54-f1be-4767-8553-48affafd1b75 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] [instance: d192f841-e952-4ba1-8e82-f8cee534ae44] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:16:18.163847 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3a35fc54-f1be-4767-8553-48affafd1b75 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:18.164356 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3a35fc54-f1be-4767-8553-48affafd1b75 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:18.164797 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3a35fc54-f1be-4767-8553-48affafd1b75 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:18.165484 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3a35fc54-f1be-4767-8553-48affafd1b75 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:18.165933 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3a35fc54-f1be-4767-8553-48affafd1b75 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:18.166349 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3a35fc54-f1be-4767-8553-48affafd1b75 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:18.297478 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-3a35fc54-f1be-4767-8553-48affafd1b75 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d237fbcac466cadbccce06ab883b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa652e067e840f1a4fee76614648726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:16:18.305287 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-3a35fc54-f1be-4767-8553-48affafd1b75 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] 10.222.0.58 "GET /compute/v2.1/servers/d192f841-e952-4ba1-8e82-f8cee534ae44" status: 200 len: 1313 microversion: 2.1 time: 0.154304 Aug 31 13:16:18.305903 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 512/998] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:16:18 2022] GET /compute/v2.1/servers/d192f841-e952-4ba1-8e82-f8cee534ae44 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:16:18.703001 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-1728a33f-93c4-4f48-91f2-67dbde0373b2 req-a1ba6979-f7df-4945-8c17-3f37c0cb8714 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d192f841-e952-4ba1-8e82-f8cee534ae44", "tag": "ae57274b-1d82-4998-8410-989cf5630ad5"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:16:18.713719 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-1728a33f-93c4-4f48-91f2-67dbde0373b2 req-a1ba6979-f7df-4945-8c17-3f37c0cb8714 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:18.714194 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-1728a33f-93c4-4f48-91f2-67dbde0373b2 req-a1ba6979-f7df-4945-8c17-3f37c0cb8714 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:18.714624 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-1728a33f-93c4-4f48-91f2-67dbde0373b2 req-a1ba6979-f7df-4945-8c17-3f37c0cb8714 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:18.728444 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-1728a33f-93c4-4f48-91f2-67dbde0373b2 req-a1ba6979-f7df-4945-8c17-3f37c0cb8714 service nova] Creating event network-changed:ae57274b-1d82-4998-8410-989cf5630ad5 for instance d192f841-e952-4ba1-8e82-f8cee534ae44 on hv-cinder-85442 Aug 31 13:16:18.734091 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-1728a33f-93c4-4f48-91f2-67dbde0373b2 req-a1ba6979-f7df-4945-8c17-3f37c0cb8714 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034809 Aug 31 13:16:18.734814 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 487/999] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:16:19.326625 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-33bb9ac6-2c1c-454f-8a5e-7955ea412288 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:16:19.327195 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-33bb9ac6-2c1c-454f-8a5e-7955ea412288 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] [instance: d192f841-e952-4ba1-8e82-f8cee534ae44] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:16:19.334318 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-33bb9ac6-2c1c-454f-8a5e-7955ea412288 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:19.334790 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-33bb9ac6-2c1c-454f-8a5e-7955ea412288 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:19.335211 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-33bb9ac6-2c1c-454f-8a5e-7955ea412288 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:19.336000 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-33bb9ac6-2c1c-454f-8a5e-7955ea412288 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:19.336442 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-33bb9ac6-2c1c-454f-8a5e-7955ea412288 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:19.336863 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-33bb9ac6-2c1c-454f-8a5e-7955ea412288 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:19.473612 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-33bb9ac6-2c1c-454f-8a5e-7955ea412288 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d237fbcac466cadbccce06ab883b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa652e067e840f1a4fee76614648726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:16:19.481445 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-33bb9ac6-2c1c-454f-8a5e-7955ea412288 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] 10.222.0.58 "GET /compute/v2.1/servers/d192f841-e952-4ba1-8e82-f8cee534ae44" status: 200 len: 1313 microversion: 2.1 time: 0.158846 Aug 31 13:16:19.482027 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 513/1000] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:16:19 2022] GET /compute/v2.1/servers/d192f841-e952-4ba1-8e82-f8cee534ae44 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:16:20.508804 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3aec10ce-2dc0-46cd-ae4e-3470774d4a07 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:16:20.509928 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-3aec10ce-2dc0-46cd-ae4e-3470774d4a07 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] [instance: d192f841-e952-4ba1-8e82-f8cee534ae44] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:16:20.521086 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3aec10ce-2dc0-46cd-ae4e-3470774d4a07 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:20.521882 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3aec10ce-2dc0-46cd-ae4e-3470774d4a07 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:20.522597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3aec10ce-2dc0-46cd-ae4e-3470774d4a07 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:20.524408 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3aec10ce-2dc0-46cd-ae4e-3470774d4a07 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:20.525169 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3aec10ce-2dc0-46cd-ae4e-3470774d4a07 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:20.525877 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3aec10ce-2dc0-46cd-ae4e-3470774d4a07 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:20.660941 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-3aec10ce-2dc0-46cd-ae4e-3470774d4a07 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d237fbcac466cadbccce06ab883b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa652e067e840f1a4fee76614648726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:16:20.668934 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-3aec10ce-2dc0-46cd-ae4e-3470774d4a07 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] 10.222.0.58 "GET /compute/v2.1/servers/d192f841-e952-4ba1-8e82-f8cee534ae44" status: 200 len: 1313 microversion: 2.1 time: 0.168445 Aug 31 13:16:20.669510 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 488/1001] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:16:20 2022] GET /compute/v2.1/servers/d192f841-e952-4ba1-8e82-f8cee534ae44 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:16:21.695628 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-e605b00d-8808-4867-b9c4-ebe5f26cf168 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:16:21.696280 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-e605b00d-8808-4867-b9c4-ebe5f26cf168 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] [instance: d192f841-e952-4ba1-8e82-f8cee534ae44] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:16:21.703213 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e605b00d-8808-4867-b9c4-ebe5f26cf168 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:21.703693 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e605b00d-8808-4867-b9c4-ebe5f26cf168 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:21.705575 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e605b00d-8808-4867-b9c4-ebe5f26cf168 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:21.705575 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e605b00d-8808-4867-b9c4-ebe5f26cf168 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:21.705991 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e605b00d-8808-4867-b9c4-ebe5f26cf168 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:21.706544 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e605b00d-8808-4867-b9c4-ebe5f26cf168 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:21.843258 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-e605b00d-8808-4867-b9c4-ebe5f26cf168 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d237fbcac466cadbccce06ab883b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa652e067e840f1a4fee76614648726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:16:21.851682 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-e605b00d-8808-4867-b9c4-ebe5f26cf168 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] 10.222.0.58 "GET /compute/v2.1/servers/d192f841-e952-4ba1-8e82-f8cee534ae44" status: 200 len: 1313 microversion: 2.1 time: 0.160020 Aug 31 13:16:21.852319 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 514/1002] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:16:21 2022] GET /compute/v2.1/servers/d192f841-e952-4ba1-8e82-f8cee534ae44 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:16:22.876926 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-165e8fc3-c667-4a3c-94fe-147232d98063 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:16:22.878174 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-165e8fc3-c667-4a3c-94fe-147232d98063 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] [instance: d192f841-e952-4ba1-8e82-f8cee534ae44] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:16:22.886097 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-165e8fc3-c667-4a3c-94fe-147232d98063 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:22.886586 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-165e8fc3-c667-4a3c-94fe-147232d98063 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:22.887018 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-165e8fc3-c667-4a3c-94fe-147232d98063 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:22.887711 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-165e8fc3-c667-4a3c-94fe-147232d98063 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:22.888221 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-165e8fc3-c667-4a3c-94fe-147232d98063 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:22.888647 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-165e8fc3-c667-4a3c-94fe-147232d98063 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:23.030022 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-165e8fc3-c667-4a3c-94fe-147232d98063 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d237fbcac466cadbccce06ab883b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa652e067e840f1a4fee76614648726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:16:23.042880 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-165e8fc3-c667-4a3c-94fe-147232d98063 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] 10.222.0.58 "GET /compute/v2.1/servers/d192f841-e952-4ba1-8e82-f8cee534ae44" status: 200 len: 1313 microversion: 2.1 time: 0.172244 Aug 31 13:16:23.043635 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 489/1003] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:16:22 2022] GET /compute/v2.1/servers/d192f841-e952-4ba1-8e82-f8cee534ae44 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:16:24.064991 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-bf7c35e5-bbc3-4a47-bfb8-2d6f3c9f248e tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:16:24.065594 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-bf7c35e5-bbc3-4a47-bfb8-2d6f3c9f248e tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] [instance: d192f841-e952-4ba1-8e82-f8cee534ae44] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:16:24.072745 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bf7c35e5-bbc3-4a47-bfb8-2d6f3c9f248e tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:24.073229 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bf7c35e5-bbc3-4a47-bfb8-2d6f3c9f248e tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:24.073657 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bf7c35e5-bbc3-4a47-bfb8-2d6f3c9f248e tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:24.074414 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bf7c35e5-bbc3-4a47-bfb8-2d6f3c9f248e tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:24.074864 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bf7c35e5-bbc3-4a47-bfb8-2d6f3c9f248e tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:24.075280 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bf7c35e5-bbc3-4a47-bfb8-2d6f3c9f248e tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:24.219555 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-bf7c35e5-bbc3-4a47-bfb8-2d6f3c9f248e tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d237fbcac466cadbccce06ab883b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa652e067e840f1a4fee76614648726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:16:24.231987 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-bf7c35e5-bbc3-4a47-bfb8-2d6f3c9f248e tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] 10.222.0.58 "GET /compute/v2.1/servers/d192f841-e952-4ba1-8e82-f8cee534ae44" status: 200 len: 1313 microversion: 2.1 time: 0.170838 Aug 31 13:16:24.232572 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 515/1004] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:16:24 2022] GET /compute/v2.1/servers/d192f841-e952-4ba1-8e82-f8cee534ae44 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:16:25.257335 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-317426de-d049-42a3-81c2-4ac5906bf99a tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:16:25.258249 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-317426de-d049-42a3-81c2-4ac5906bf99a tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] [instance: d192f841-e952-4ba1-8e82-f8cee534ae44] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:16:25.269385 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-317426de-d049-42a3-81c2-4ac5906bf99a tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:25.270177 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-317426de-d049-42a3-81c2-4ac5906bf99a tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:25.270943 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-317426de-d049-42a3-81c2-4ac5906bf99a tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:25.272169 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-317426de-d049-42a3-81c2-4ac5906bf99a tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:25.272919 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-317426de-d049-42a3-81c2-4ac5906bf99a tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:25.273664 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-317426de-d049-42a3-81c2-4ac5906bf99a tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:25.418057 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-317426de-d049-42a3-81c2-4ac5906bf99a tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d237fbcac466cadbccce06ab883b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa652e067e840f1a4fee76614648726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:16:25.426251 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-317426de-d049-42a3-81c2-4ac5906bf99a tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] 10.222.0.58 "GET /compute/v2.1/servers/d192f841-e952-4ba1-8e82-f8cee534ae44" status: 200 len: 1313 microversion: 2.1 time: 0.175729 Aug 31 13:16:25.426820 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 490/1005] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:16:25 2022] GET /compute/v2.1/servers/d192f841-e952-4ba1-8e82-f8cee534ae44 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:16:25.991520 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-76934432-6371-4d9a-acae-8b6520fe0ef5 req-52705615-dc71-42f3-9844-dc53eb8ba775 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d192f841-e952-4ba1-8e82-f8cee534ae44", "name": "network-vif-plugged", "status": "completed", "tag": "ae57274b-1d82-4998-8410-989cf5630ad5"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:16:26.001931 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-76934432-6371-4d9a-acae-8b6520fe0ef5 req-52705615-dc71-42f3-9844-dc53eb8ba775 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:26.002398 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-76934432-6371-4d9a-acae-8b6520fe0ef5 req-52705615-dc71-42f3-9844-dc53eb8ba775 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:26.002820 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-76934432-6371-4d9a-acae-8b6520fe0ef5 req-52705615-dc71-42f3-9844-dc53eb8ba775 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:26.014357 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-76934432-6371-4d9a-acae-8b6520fe0ef5 req-52705615-dc71-42f3-9844-dc53eb8ba775 service nova] Creating event network-vif-plugged:ae57274b-1d82-4998-8410-989cf5630ad5 for instance d192f841-e952-4ba1-8e82-f8cee534ae44 on hv-cinder-85442 Aug 31 13:16:26.019443 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-76934432-6371-4d9a-acae-8b6520fe0ef5 req-52705615-dc71-42f3-9844-dc53eb8ba775 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031783 Aug 31 13:16:26.020040 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 516/1006] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:16:26.449158 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-aa1b2eca-7fd9-4714-a81a-878c6fcb16f3 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:16:26.449763 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-aa1b2eca-7fd9-4714-a81a-878c6fcb16f3 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] [instance: d192f841-e952-4ba1-8e82-f8cee534ae44] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:16:26.451978 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=2 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:16:26.452764 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=6 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:16:26.459836 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-aa1b2eca-7fd9-4714-a81a-878c6fcb16f3 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:26.460321 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-aa1b2eca-7fd9-4714-a81a-878c6fcb16f3 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:26.460756 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-aa1b2eca-7fd9-4714-a81a-878c6fcb16f3 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:26.461480 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-aa1b2eca-7fd9-4714-a81a-878c6fcb16f3 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:26.461930 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-aa1b2eca-7fd9-4714-a81a-878c6fcb16f3 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:26.462351 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-aa1b2eca-7fd9-4714-a81a-878c6fcb16f3 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:26.601406 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-aa1b2eca-7fd9-4714-a81a-878c6fcb16f3 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d237fbcac466cadbccce06ab883b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa652e067e840f1a4fee76614648726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:16:26.612793 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-aa1b2eca-7fd9-4714-a81a-878c6fcb16f3 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] 10.222.0.58 "GET /compute/v2.1/servers/d192f841-e952-4ba1-8e82-f8cee534ae44" status: 200 len: 1313 microversion: 2.1 time: 0.168578 Aug 31 13:16:26.613738 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 491/1007] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:16:26 2022] GET /compute/v2.1/servers/d192f841-e952-4ba1-8e82-f8cee534ae44 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:16:27.636004 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell0:SELECT=2 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:16:27.643556 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-1fcc19bd-da8f-4a8e-a78c-a5efb96927f0 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:16:27.644719 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-1fcc19bd-da8f-4a8e-a78c-a5efb96927f0 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] [instance: d192f841-e952-4ba1-8e82-f8cee534ae44] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:16:27.654134 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1fcc19bd-da8f-4a8e-a78c-a5efb96927f0 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:27.654921 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1fcc19bd-da8f-4a8e-a78c-a5efb96927f0 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:27.655341 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1fcc19bd-da8f-4a8e-a78c-a5efb96927f0 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:27.656052 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1fcc19bd-da8f-4a8e-a78c-a5efb96927f0 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:27.656486 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1fcc19bd-da8f-4a8e-a78c-a5efb96927f0 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:27.656893 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1fcc19bd-da8f-4a8e-a78c-a5efb96927f0 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:27.797039 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-1fcc19bd-da8f-4a8e-a78c-a5efb96927f0 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d237fbcac466cadbccce06ab883b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa652e067e840f1a4fee76614648726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:16:27.809910 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-1fcc19bd-da8f-4a8e-a78c-a5efb96927f0 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] 10.222.0.58 "GET /compute/v2.1/servers/d192f841-e952-4ba1-8e82-f8cee534ae44" status: 200 len: 1313 microversion: 2.1 time: 0.175399 Aug 31 13:16:27.810707 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 517/1008] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:16:27 2022] GET /compute/v2.1/servers/d192f841-e952-4ba1-8e82-f8cee534ae44 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:16:28.836519 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-0abd753d-5cf4-4b0c-a5f5-e231271ced71 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:16:28.837227 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-0abd753d-5cf4-4b0c-a5f5-e231271ced71 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] [instance: d192f841-e952-4ba1-8e82-f8cee534ae44] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:16:28.844787 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0abd753d-5cf4-4b0c-a5f5-e231271ced71 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:28.845258 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0abd753d-5cf4-4b0c-a5f5-e231271ced71 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:28.845689 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0abd753d-5cf4-4b0c-a5f5-e231271ced71 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:28.846364 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0abd753d-5cf4-4b0c-a5f5-e231271ced71 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:28.846805 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0abd753d-5cf4-4b0c-a5f5-e231271ced71 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:28.847216 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0abd753d-5cf4-4b0c-a5f5-e231271ced71 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:28.984971 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-0abd753d-5cf4-4b0c-a5f5-e231271ced71 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d237fbcac466cadbccce06ab883b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa652e067e840f1a4fee76614648726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:16:28.993653 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-0abd753d-5cf4-4b0c-a5f5-e231271ced71 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] 10.222.0.58 "GET /compute/v2.1/servers/d192f841-e952-4ba1-8e82-f8cee534ae44" status: 200 len: 1497 microversion: 2.1 time: 0.161775 Aug 31 13:16:28.994913 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 492/1009] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:16:28 2022] GET /compute/v2.1/servers/d192f841-e952-4ba1-8e82-f8cee534ae44 => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:16:29.551494 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-d77d8b0d-c3fd-49b4-af89-651987679687 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:16:29.552079 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-d77d8b0d-c3fd-49b4-af89-651987679687 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] [instance: d192f841-e952-4ba1-8e82-f8cee534ae44] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:16:29.558960 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d77d8b0d-c3fd-49b4-af89-651987679687 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:29.559442 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d77d8b0d-c3fd-49b4-af89-651987679687 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:29.559897 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d77d8b0d-c3fd-49b4-af89-651987679687 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:29.560592 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d77d8b0d-c3fd-49b4-af89-651987679687 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:29.561042 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d77d8b0d-c3fd-49b4-af89-651987679687 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:29.561459 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d77d8b0d-c3fd-49b4-af89-651987679687 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:29.586913 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-d77d8b0d-c3fd-49b4-af89-651987679687 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] [instance: d192f841-e952-4ba1-8e82-f8cee534ae44] Going to try to terminate instance {{(pid=120704) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 13:16:29.669413 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-d77d8b0d-c3fd-49b4-af89-651987679687 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d192f841-e952-4ba1-8e82-f8cee534ae44" status: 204 len: 0 microversion: 2.1 time: 0.121810 Aug 31 13:16:29.670127 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 518/1010] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 31 13:16:29 2022] DELETE /compute/v2.1/servers/d192f841-e952-4ba1-8e82-f8cee534ae44 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:16:29.679944 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-bc5e1660-d6d4-4e5a-a51c-7242d3e5ccfa tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:16:29.680556 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-bc5e1660-d6d4-4e5a-a51c-7242d3e5ccfa tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] [instance: d192f841-e952-4ba1-8e82-f8cee534ae44] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:16:29.687531 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bc5e1660-d6d4-4e5a-a51c-7242d3e5ccfa tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:29.688103 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bc5e1660-d6d4-4e5a-a51c-7242d3e5ccfa tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:29.688653 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bc5e1660-d6d4-4e5a-a51c-7242d3e5ccfa tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:29.689529 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bc5e1660-d6d4-4e5a-a51c-7242d3e5ccfa tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:29.690036 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bc5e1660-d6d4-4e5a-a51c-7242d3e5ccfa tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:29.690457 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bc5e1660-d6d4-4e5a-a51c-7242d3e5ccfa tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:29.825161 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-bc5e1660-d6d4-4e5a-a51c-7242d3e5ccfa tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d237fbcac466cadbccce06ab883b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa652e067e840f1a4fee76614648726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:16:29.837125 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-bc5e1660-d6d4-4e5a-a51c-7242d3e5ccfa tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] 10.222.0.58 "GET /compute/v2.1/servers/d192f841-e952-4ba1-8e82-f8cee534ae44" status: 200 len: 1503 microversion: 2.1 time: 0.162131 Aug 31 13:16:29.837887 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 493/1011] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:16:29 2022] GET /compute/v2.1/servers/d192f841-e952-4ba1-8e82-f8cee534ae44 => generated 1503 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:16:30.864096 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-ad8af1c9-e1df-40e0-bde2-a9525872760e tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:16:30.865204 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-ad8af1c9-e1df-40e0-bde2-a9525872760e tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] [instance: d192f841-e952-4ba1-8e82-f8cee534ae44] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:16:30.876275 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ad8af1c9-e1df-40e0-bde2-a9525872760e tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:30.877066 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ad8af1c9-e1df-40e0-bde2-a9525872760e tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:30.877799 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ad8af1c9-e1df-40e0-bde2-a9525872760e tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:30.878938 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ad8af1c9-e1df-40e0-bde2-a9525872760e tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:30.879683 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ad8af1c9-e1df-40e0-bde2-a9525872760e tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:30.880431 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ad8af1c9-e1df-40e0-bde2-a9525872760e tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:31.024260 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-ad8af1c9-e1df-40e0-bde2-a9525872760e tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d237fbcac466cadbccce06ab883b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa652e067e840f1a4fee76614648726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:16:31.035977 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-ad8af1c9-e1df-40e0-bde2-a9525872760e tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] 10.222.0.58 "GET /compute/v2.1/servers/d192f841-e952-4ba1-8e82-f8cee534ae44" status: 200 len: 1503 microversion: 2.1 time: 0.179037 Aug 31 13:16:31.036765 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 519/1012] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:16:30 2022] GET /compute/v2.1/servers/d192f841-e952-4ba1-8e82-f8cee534ae44 => generated 1503 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:16:32.059908 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-931ff7c4-bc8a-4199-beca-b52e266402e6 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:16:32.060559 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-931ff7c4-bc8a-4199-beca-b52e266402e6 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] [instance: d192f841-e952-4ba1-8e82-f8cee534ae44] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:16:32.067578 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-931ff7c4-bc8a-4199-beca-b52e266402e6 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:32.068075 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-931ff7c4-bc8a-4199-beca-b52e266402e6 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:32.068510 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-931ff7c4-bc8a-4199-beca-b52e266402e6 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:32.069206 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-931ff7c4-bc8a-4199-beca-b52e266402e6 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:32.069658 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-931ff7c4-bc8a-4199-beca-b52e266402e6 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:32.070081 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-931ff7c4-bc8a-4199-beca-b52e266402e6 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:32.209854 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-931ff7c4-bc8a-4199-beca-b52e266402e6 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d237fbcac466cadbccce06ab883b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa652e067e840f1a4fee76614648726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:16:32.218852 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-931ff7c4-bc8a-4199-beca-b52e266402e6 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] 10.222.0.58 "GET /compute/v2.1/servers/d192f841-e952-4ba1-8e82-f8cee534ae44" status: 200 len: 1503 microversion: 2.1 time: 0.164197 Aug 31 13:16:32.219729 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 494/1013] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:16:32 2022] GET /compute/v2.1/servers/d192f841-e952-4ba1-8e82-f8cee534ae44 => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:16:32.319357 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-7426af2b-b6cf-40d7-aa8e-9ed16b7321bb req-7451fd76-eefd-4a52-ae5c-b2a2e078030a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d192f841-e952-4ba1-8e82-f8cee534ae44", "name": "network-vif-deleted", "tag": "ae57274b-1d82-4998-8410-989cf5630ad5"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:16:32.330716 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-7426af2b-b6cf-40d7-aa8e-9ed16b7321bb req-7451fd76-eefd-4a52-ae5c-b2a2e078030a service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:32.331264 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-7426af2b-b6cf-40d7-aa8e-9ed16b7321bb req-7451fd76-eefd-4a52-ae5c-b2a2e078030a service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:32.331687 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-7426af2b-b6cf-40d7-aa8e-9ed16b7321bb req-7451fd76-eefd-4a52-ae5c-b2a2e078030a service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:32.343460 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-7426af2b-b6cf-40d7-aa8e-9ed16b7321bb req-7451fd76-eefd-4a52-ae5c-b2a2e078030a service nova] Creating event network-vif-deleted:ae57274b-1d82-4998-8410-989cf5630ad5 for instance d192f841-e952-4ba1-8e82-f8cee534ae44 on hv-cinder-85442 Aug 31 13:16:32.348559 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-7426af2b-b6cf-40d7-aa8e-9ed16b7321bb req-7451fd76-eefd-4a52-ae5c-b2a2e078030a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033019 Aug 31 13:16:32.349173 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 520/1014] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:16:33.245502 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-818464a3-2e48-4c6c-ae9d-e867ebfc2513 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:16:33.246504 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-818464a3-2e48-4c6c-ae9d-e867ebfc2513 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] [instance: d192f841-e952-4ba1-8e82-f8cee534ae44] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:16:33.258045 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-818464a3-2e48-4c6c-ae9d-e867ebfc2513 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:33.258867 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-818464a3-2e48-4c6c-ae9d-e867ebfc2513 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:33.259612 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-818464a3-2e48-4c6c-ae9d-e867ebfc2513 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:33.260648 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-818464a3-2e48-4c6c-ae9d-e867ebfc2513 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:33.261094 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-818464a3-2e48-4c6c-ae9d-e867ebfc2513 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:33.261506 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-818464a3-2e48-4c6c-ae9d-e867ebfc2513 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:33.275290 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-818464a3-2e48-4c6c-ae9d-e867ebfc2513 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] HTTP exception thrown: Instance d192f841-e952-4ba1-8e82-f8cee534ae44 could not be found. Aug 31 13:16:33.276957 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-818464a3-2e48-4c6c-ae9d-e867ebfc2513 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Request method failure captured: Aug 31 13:16:33.276957 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: request: GET /compute/v2.1/servers/d192f841-e952-4ba1-8e82-f8cee534ae44 HTTP/1.1 Aug 31 13:16:33.276957 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 31 13:16:33.276957 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 31 13:16:33.276957 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Connection: close Aug 31 13:16:33.276957 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 31 13:16:33.276957 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 31 13:16:33.276957 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Host: 10.222.0.58 Aug 31 13:16:33.276957 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 31 13:16:33.276957 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 31 13:16:33.276957 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjD18dPvda-L_Mv487vhQW-2HQbVvxr30NR1Hyjtco8SZntUjrsTFg8SVvkZvwm7D_ipQe9SPWcpqSHKaivfYzj0kLjZywpjRJnrekFPLw7aDrO6ABi-OQPcKWs6VNKvqggF3RlhynFKLNTcRwCWCKE5jE56zLk0JyxGaK6jkGlomAUEQ Aug 31 13:16:33.276957 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 31 13:16:33.276957 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 31 13:16:33.276957 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 31 13:16:33.276957 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 31 13:16:33.276957 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 31 13:16:33.276957 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 31 13:16:33.276957 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Id: efa652e067e840f1a4fee76614648726 Aug 31 13:16:33.276957 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-VolumesActionsTest-1863774945 Aug 31 13:16:33.276957 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Role: member,reader Aug 31 13:16:33.276957 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Roles: member,reader Aug 31 13:16:33.278575 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_efa652e067e840f1a4fee76614648726"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/efa652e067e840f1a4fee76614648726"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/efa652e067e840f1a4fee76614648726"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/efa652e067e840f1a4fee76614648726"}]}] Aug 31 13:16:33.278575 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-VolumesActionsTest-1863774945 Aug 31 13:16:33.278575 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant-Id: efa652e067e840f1a4fee76614648726 Aug 31 13:16:33.278575 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-VolumesActionsTest-1863774945 Aug 31 13:16:33.278575 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User: tempest-VolumesActionsTest-1863774945-project Aug 31 13:16:33.278575 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 31 13:16:33.278575 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 31 13:16:33.278575 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Id: be2d237fbcac466cadbccce06ab883b6 Aug 31 13:16:33.278575 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-VolumesActionsTest-1863774945-project Aug 31 13:16:33.278575 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: method: > Aug 31 13:16:33.278575 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: exception: Instance d192f841-e952-4ba1-8e82-f8cee534ae44 could not be found. Aug 31 13:16:33.278575 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: action_args: {'id': 'd192f841-e952-4ba1-8e82-f8cee534ae44'} Aug 31 13:16:33.279804 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:16:33.279804 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:16:33.279804 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 13:16:33.279804 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 13:16:33.279804 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 13:16:33.279804 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 13:16:33.279804 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 13:16:33.279804 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 13:16:33.279804 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 13:16:33.279804 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 13:16:33.279804 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d192f841-e952-4ba1-8e82-f8cee534ae44 could not be found. Aug 31 13:16:33.279804 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:16:33.279804 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:16:33.279804 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:16:33.279804 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:16:33.279804 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:16:33.279804 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:16:33.279804 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:16:33.279804 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:16:33.279804 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:16:33.281250 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:16:33.281250 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 13:16:33.281250 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 13:16:33.281250 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 13:16:33.281250 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 13:16:33.281250 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 13:16:33.281250 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 13:16:33.281250 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d192f841-e952-4ba1-8e82-f8cee534ae44 could not be found. Aug 31 13:16:33.281250 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:16:33.281250 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:16:33.281250 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:16:33.281250 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:16:33.281250 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:16:33.281250 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:16:33.281250 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:16:33.281250 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:16:33.281250 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d192f841-e952-4ba1-8e82-f8cee534ae44 could not be found. Aug 31 13:16:33.281250 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:16:33.282797 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-818464a3-2e48-4c6c-ae9d-e867ebfc2513 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Returning 404 to user: Instance d192f841-e952-4ba1-8e82-f8cee534ae44 could not be found. {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:16:33.282797 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-818464a3-2e48-4c6c-ae9d-e867ebfc2513 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] 10.222.0.58 "GET /compute/v2.1/servers/d192f841-e952-4ba1-8e82-f8cee534ae44" status: 404 len: 111 microversion: 2.1 time: 0.039547 Aug 31 13:16:33.282797 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 495/1015] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:16:33 2022] GET /compute/v2.1/servers/d192f841-e952-4ba1-8e82-f8cee534ae44 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:16:33.331543 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-c7854fff-441b-43a1-9b82-b2a3a04865fa tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1802189764", "imageRef": "2aa55919-0f25-4e84-a2e1-f60acbe208b2", "flavorRef": "452", "networks": [{"uuid": "4a9138c0-aaa9-43ac-a4e7-cef6c4a42b05"}]}} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:16:33.391306 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.network.neutron [None req-c7854fff-441b-43a1-9b82-b2a3a04865fa tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] validate_networks() for [('4a9138c0-aaa9-43ac-a4e7-cef6c4a42b05', None, None, None, None, None)] {{(pid=120704) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 13:16:33.756927 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.virt.hardware [None req-c7854fff-441b-43a1-9b82-b2a3a04865fa tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Flavor limits 0:0:0 {{(pid=120704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 13:16:33.757525 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.virt.hardware [None req-c7854fff-441b-43a1-9b82-b2a3a04865fa tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Image limits 0:0:0 {{(pid=120704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 13:16:33.758210 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.virt.hardware [None req-c7854fff-441b-43a1-9b82-b2a3a04865fa tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Flavor pref 0:0:0 {{(pid=120704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 13:16:33.758798 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.virt.hardware [None req-c7854fff-441b-43a1-9b82-b2a3a04865fa tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Image pref 0:0:0 {{(pid=120704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 13:16:33.759358 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.virt.hardware [None req-c7854fff-441b-43a1-9b82-b2a3a04865fa tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 13:16:33.769137 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c7854fff-441b-43a1-9b82-b2a3a04865fa tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:33.769608 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c7854fff-441b-43a1-9b82-b2a3a04865fa tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:33.770064 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c7854fff-441b-43a1-9b82-b2a3a04865fa tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:33.770788 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c7854fff-441b-43a1-9b82-b2a3a04865fa tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:33.771230 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c7854fff-441b-43a1-9b82-b2a3a04865fa tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:33.771646 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c7854fff-441b-43a1-9b82-b2a3a04865fa tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:33.789821 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.quota [None req-c7854fff-441b-43a1-9b82-b2a3a04865fa tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Getting quotas for project efa652e067e840f1a4fee76614648726. Resources: {'instances', 'ram', 'cores'} {{(pid=120704) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 13:16:33.794608 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.quota [None req-c7854fff-441b-43a1-9b82-b2a3a04865fa tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Getting quotas for user be2d237fbcac466cadbccce06ab883b6 and project efa652e067e840f1a4fee76614648726. Resources: {'instances', 'ram', 'cores'} {{(pid=120704) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 13:16:33.811868 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-c7854fff-441b-43a1-9b82-b2a3a04865fa tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Going to run 1 instances... {{(pid=120704) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 13:16:33.815611 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-c7854fff-441b-43a1-9b82-b2a3a04865fa tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] [instance: e3c1b762-aa16-48ce-bf27-9c570172ab04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2aa55919-0f25-4e84-a2e1-f60acbe208b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120704) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 13:16:33.865588 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-c7854fff-441b-43a1-9b82-b2a3a04865fa tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.538699 Aug 31 13:16:33.866247 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 521/1016] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 31 13:16:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 13:16:33.877322 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-eef2eb53-cb9b-4e83-aa50-3b89f7a0e69f tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:16:33.877910 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-eef2eb53-cb9b-4e83-aa50-3b89f7a0e69f tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] [instance: e3c1b762-aa16-48ce-bf27-9c570172ab04] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:16:33.931043 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-eef2eb53-cb9b-4e83-aa50-3b89f7a0e69f tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d237fbcac466cadbccce06ab883b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa652e067e840f1a4fee76614648726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:16:33.938176 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-eef2eb53-cb9b-4e83-aa50-3b89f7a0e69f tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] 10.222.0.58 "GET /compute/v2.1/servers/e3c1b762-aa16-48ce-bf27-9c570172ab04" status: 200 len: 1214 microversion: 2.1 time: 0.064721 Aug 31 13:16:33.938737 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 496/1017] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:16:33 2022] GET /compute/v2.1/servers/e3c1b762-aa16-48ce-bf27-9c570172ab04 => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:16:34.959619 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-3f453637-78d5-492f-961c-4906dc12d2ef tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:16:34.960308 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-3f453637-78d5-492f-961c-4906dc12d2ef tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] [instance: e3c1b762-aa16-48ce-bf27-9c570172ab04] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:16:35.013653 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-3f453637-78d5-492f-961c-4906dc12d2ef tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d237fbcac466cadbccce06ab883b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa652e067e840f1a4fee76614648726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:16:35.021658 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-3f453637-78d5-492f-961c-4906dc12d2ef tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] 10.222.0.58 "GET /compute/v2.1/servers/e3c1b762-aa16-48ce-bf27-9c570172ab04" status: 200 len: 1214 microversion: 2.1 time: 0.066922 Aug 31 13:16:35.022226 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 522/1018] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:16:34 2022] GET /compute/v2.1/servers/e3c1b762-aa16-48ce-bf27-9c570172ab04 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:16:36.043610 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-f3dd112d-99f5-4bec-89c8-e76cc50cedb8 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:16:36.044251 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-f3dd112d-99f5-4bec-89c8-e76cc50cedb8 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] [instance: e3c1b762-aa16-48ce-bf27-9c570172ab04] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:16:36.098406 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-f3dd112d-99f5-4bec-89c8-e76cc50cedb8 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d237fbcac466cadbccce06ab883b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa652e067e840f1a4fee76614648726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:16:36.105758 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-f3dd112d-99f5-4bec-89c8-e76cc50cedb8 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] 10.222.0.58 "GET /compute/v2.1/servers/e3c1b762-aa16-48ce-bf27-9c570172ab04" status: 200 len: 1214 microversion: 2.1 time: 0.066377 Aug 31 13:16:36.118784 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 497/1019] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:16:36 2022] GET /compute/v2.1/servers/e3c1b762-aa16-48ce-bf27-9c570172ab04 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:16:37.127406 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-cc0e867a-3e97-48ff-92d2-8037688edaeb tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:16:37.128088 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-cc0e867a-3e97-48ff-92d2-8037688edaeb tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] [instance: e3c1b762-aa16-48ce-bf27-9c570172ab04] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:16:37.186519 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-cc0e867a-3e97-48ff-92d2-8037688edaeb tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d237fbcac466cadbccce06ab883b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa652e067e840f1a4fee76614648726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:16:37.193685 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-cc0e867a-3e97-48ff-92d2-8037688edaeb tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] 10.222.0.58 "GET /compute/v2.1/servers/e3c1b762-aa16-48ce-bf27-9c570172ab04" status: 200 len: 1214 microversion: 2.1 time: 0.070494 Aug 31 13:16:37.194261 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 523/1020] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:16:37 2022] GET /compute/v2.1/servers/e3c1b762-aa16-48ce-bf27-9c570172ab04 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:16:38.219011 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-5f72b446-3fab-45f9-a20a-ea56af91bb91 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:16:38.219954 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-5f72b446-3fab-45f9-a20a-ea56af91bb91 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] [instance: e3c1b762-aa16-48ce-bf27-9c570172ab04] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:16:38.231257 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5f72b446-3fab-45f9-a20a-ea56af91bb91 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:38.232158 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5f72b446-3fab-45f9-a20a-ea56af91bb91 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:38.232593 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5f72b446-3fab-45f9-a20a-ea56af91bb91 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:38.233279 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5f72b446-3fab-45f9-a20a-ea56af91bb91 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:38.233729 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5f72b446-3fab-45f9-a20a-ea56af91bb91 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:38.234145 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5f72b446-3fab-45f9-a20a-ea56af91bb91 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:38.305164 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-5f72b446-3fab-45f9-a20a-ea56af91bb91 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d237fbcac466cadbccce06ab883b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa652e067e840f1a4fee76614648726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:16:38.313374 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-5f72b446-3fab-45f9-a20a-ea56af91bb91 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] 10.222.0.58 "GET /compute/v2.1/servers/e3c1b762-aa16-48ce-bf27-9c570172ab04" status: 200 len: 1218 microversion: 2.1 time: 0.101108 Aug 31 13:16:38.314120 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 498/1021] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:16:38 2022] GET /compute/v2.1/servers/e3c1b762-aa16-48ce-bf27-9c570172ab04 => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:16:39.334382 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-c273a788-38e4-4a81-a520-bc2aae89c64a tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:16:39.335058 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-c273a788-38e4-4a81-a520-bc2aae89c64a tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] [instance: e3c1b762-aa16-48ce-bf27-9c570172ab04] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:16:39.342635 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c273a788-38e4-4a81-a520-bc2aae89c64a tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:39.343108 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c273a788-38e4-4a81-a520-bc2aae89c64a tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:39.343533 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c273a788-38e4-4a81-a520-bc2aae89c64a tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:39.344266 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c273a788-38e4-4a81-a520-bc2aae89c64a tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:39.344718 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c273a788-38e4-4a81-a520-bc2aae89c64a tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:39.345133 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c273a788-38e4-4a81-a520-bc2aae89c64a tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:39.406688 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-c273a788-38e4-4a81-a520-bc2aae89c64a tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d237fbcac466cadbccce06ab883b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa652e067e840f1a4fee76614648726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:16:39.414601 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-c273a788-38e4-4a81-a520-bc2aae89c64a tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] 10.222.0.58 "GET /compute/v2.1/servers/e3c1b762-aa16-48ce-bf27-9c570172ab04" status: 200 len: 1272 microversion: 2.1 time: 0.084194 Aug 31 13:16:39.415176 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 524/1022] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:16:39 2022] GET /compute/v2.1/servers/e3c1b762-aa16-48ce-bf27-9c570172ab04 => generated 1272 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:16:40.406136 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-f352ae3d-329d-4a1a-9cd8-aca0b9ddc2d3 req-5b89371e-ca01-4c78-8146-f162b4729fd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3c1b762-aa16-48ce-bf27-9c570172ab04", "tag": "33e68ffa-bab7-4a15-a71b-6ba45c52062a"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:16:40.417283 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-f352ae3d-329d-4a1a-9cd8-aca0b9ddc2d3 req-5b89371e-ca01-4c78-8146-f162b4729fd0 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:40.417894 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-f352ae3d-329d-4a1a-9cd8-aca0b9ddc2d3 req-5b89371e-ca01-4c78-8146-f162b4729fd0 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:40.418319 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-f352ae3d-329d-4a1a-9cd8-aca0b9ddc2d3 req-5b89371e-ca01-4c78-8146-f162b4729fd0 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:40.430445 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-f352ae3d-329d-4a1a-9cd8-aca0b9ddc2d3 req-5b89371e-ca01-4c78-8146-f162b4729fd0 service nova] Creating event network-changed:33e68ffa-bab7-4a15-a71b-6ba45c52062a for instance e3c1b762-aa16-48ce-bf27-9c570172ab04 on hv-cinder-85442 Aug 31 13:16:40.435610 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-f352ae3d-329d-4a1a-9cd8-aca0b9ddc2d3 req-5b89371e-ca01-4c78-8146-f162b4729fd0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033823 Aug 31 13:16:40.436399 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 499/1023] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:16:40.437718 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-5252fbb6-acf6-4d08-9a55-edd44ec07645 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:16:40.438457 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-5252fbb6-acf6-4d08-9a55-edd44ec07645 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] [instance: e3c1b762-aa16-48ce-bf27-9c570172ab04] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:16:40.445334 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5252fbb6-acf6-4d08-9a55-edd44ec07645 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:40.446116 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5252fbb6-acf6-4d08-9a55-edd44ec07645 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:40.446545 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5252fbb6-acf6-4d08-9a55-edd44ec07645 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:40.447258 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5252fbb6-acf6-4d08-9a55-edd44ec07645 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:40.447873 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5252fbb6-acf6-4d08-9a55-edd44ec07645 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:40.448283 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5252fbb6-acf6-4d08-9a55-edd44ec07645 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:40.585078 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-5252fbb6-acf6-4d08-9a55-edd44ec07645 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d237fbcac466cadbccce06ab883b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa652e067e840f1a4fee76614648726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:16:40.593147 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-5252fbb6-acf6-4d08-9a55-edd44ec07645 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] 10.222.0.58 "GET /compute/v2.1/servers/e3c1b762-aa16-48ce-bf27-9c570172ab04" status: 200 len: 1314 microversion: 2.1 time: 0.161233 Aug 31 13:16:40.594107 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 525/1024] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:16:40 2022] GET /compute/v2.1/servers/e3c1b762-aa16-48ce-bf27-9c570172ab04 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:16:41.619998 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-db39135e-6c65-4f05-b185-4644923f42fa tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:16:41.621158 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-db39135e-6c65-4f05-b185-4644923f42fa tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] [instance: e3c1b762-aa16-48ce-bf27-9c570172ab04] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:16:41.628898 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-db39135e-6c65-4f05-b185-4644923f42fa tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:41.629376 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-db39135e-6c65-4f05-b185-4644923f42fa tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:41.629816 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-db39135e-6c65-4f05-b185-4644923f42fa tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:41.630510 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-db39135e-6c65-4f05-b185-4644923f42fa tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:41.630964 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-db39135e-6c65-4f05-b185-4644923f42fa tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:41.631387 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-db39135e-6c65-4f05-b185-4644923f42fa tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:41.777520 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-db39135e-6c65-4f05-b185-4644923f42fa tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d237fbcac466cadbccce06ab883b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa652e067e840f1a4fee76614648726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:16:41.786401 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-db39135e-6c65-4f05-b185-4644923f42fa tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] 10.222.0.58 "GET /compute/v2.1/servers/e3c1b762-aa16-48ce-bf27-9c570172ab04" status: 200 len: 1314 microversion: 2.1 time: 0.174520 Aug 31 13:16:41.786983 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 500/1025] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:16:41 2022] GET /compute/v2.1/servers/e3c1b762-aa16-48ce-bf27-9c570172ab04 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:16:42.811011 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-ceec0944-bc41-45a9-a928-878c55641f4b tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:16:42.812007 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-ceec0944-bc41-45a9-a928-878c55641f4b tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] [instance: e3c1b762-aa16-48ce-bf27-9c570172ab04] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:16:42.823133 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ceec0944-bc41-45a9-a928-878c55641f4b tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:42.823965 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ceec0944-bc41-45a9-a928-878c55641f4b tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:42.824707 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ceec0944-bc41-45a9-a928-878c55641f4b tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:42.825821 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ceec0944-bc41-45a9-a928-878c55641f4b tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:42.826559 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ceec0944-bc41-45a9-a928-878c55641f4b tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:42.826982 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ceec0944-bc41-45a9-a928-878c55641f4b tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:42.970832 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-ceec0944-bc41-45a9-a928-878c55641f4b tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d237fbcac466cadbccce06ab883b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa652e067e840f1a4fee76614648726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:16:42.978770 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-ceec0944-bc41-45a9-a928-878c55641f4b tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] 10.222.0.58 "GET /compute/v2.1/servers/e3c1b762-aa16-48ce-bf27-9c570172ab04" status: 200 len: 1314 microversion: 2.1 time: 0.174517 Aug 31 13:16:42.979357 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 526/1026] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:16:42 2022] GET /compute/v2.1/servers/e3c1b762-aa16-48ce-bf27-9c570172ab04 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:16:44.000612 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-4e65fe44-1b82-42a5-a528-9bc40877e74b tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:16:44.001241 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-4e65fe44-1b82-42a5-a528-9bc40877e74b tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] [instance: e3c1b762-aa16-48ce-bf27-9c570172ab04] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:16:44.008272 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4e65fe44-1b82-42a5-a528-9bc40877e74b tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:44.008762 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4e65fe44-1b82-42a5-a528-9bc40877e74b tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:44.009198 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4e65fe44-1b82-42a5-a528-9bc40877e74b tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:44.009891 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4e65fe44-1b82-42a5-a528-9bc40877e74b tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:44.010342 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4e65fe44-1b82-42a5-a528-9bc40877e74b tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:44.010766 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4e65fe44-1b82-42a5-a528-9bc40877e74b tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:44.403575 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-4e65fe44-1b82-42a5-a528-9bc40877e74b tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d237fbcac466cadbccce06ab883b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa652e067e840f1a4fee76614648726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:16:44.415732 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-4e65fe44-1b82-42a5-a528-9bc40877e74b tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] 10.222.0.58 "GET /compute/v2.1/servers/e3c1b762-aa16-48ce-bf27-9c570172ab04" status: 200 len: 1314 microversion: 2.1 time: 0.418884 Aug 31 13:16:44.416533 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 501/1027] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:16:43 2022] GET /compute/v2.1/servers/e3c1b762-aa16-48ce-bf27-9c570172ab04 => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:16:45.442077 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-4b3c3130-ef91-462e-86f3-8078c6b7293d tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:16:45.442769 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-4b3c3130-ef91-462e-86f3-8078c6b7293d tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] [instance: e3c1b762-aa16-48ce-bf27-9c570172ab04] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:16:45.445384 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell0:SELECT=2 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:16:45.452713 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4b3c3130-ef91-462e-86f3-8078c6b7293d tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:45.453305 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4b3c3130-ef91-462e-86f3-8078c6b7293d tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:45.453858 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4b3c3130-ef91-462e-86f3-8078c6b7293d tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:45.454674 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4b3c3130-ef91-462e-86f3-8078c6b7293d tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:45.455230 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4b3c3130-ef91-462e-86f3-8078c6b7293d tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:45.455743 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4b3c3130-ef91-462e-86f3-8078c6b7293d tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:45.595402 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-4b3c3130-ef91-462e-86f3-8078c6b7293d tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d237fbcac466cadbccce06ab883b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa652e067e840f1a4fee76614648726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:16:45.603320 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-4b3c3130-ef91-462e-86f3-8078c6b7293d tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] 10.222.0.58 "GET /compute/v2.1/servers/e3c1b762-aa16-48ce-bf27-9c570172ab04" status: 200 len: 1314 microversion: 2.1 time: 0.166878 Aug 31 13:16:45.603916 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 527/1028] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:16:45 2022] GET /compute/v2.1/servers/e3c1b762-aa16-48ce-bf27-9c570172ab04 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:16:46.628508 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-9df5ef74-527f-4ca6-9215-7a6af5c842e0 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:16:46.629459 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-9df5ef74-527f-4ca6-9215-7a6af5c842e0 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] [instance: e3c1b762-aa16-48ce-bf27-9c570172ab04] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:16:46.635312 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=4 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:16:46.636431 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:16:46.642933 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9df5ef74-527f-4ca6-9215-7a6af5c842e0 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:46.643414 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9df5ef74-527f-4ca6-9215-7a6af5c842e0 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:46.643872 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9df5ef74-527f-4ca6-9215-7a6af5c842e0 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:46.644573 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9df5ef74-527f-4ca6-9215-7a6af5c842e0 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:46.645025 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9df5ef74-527f-4ca6-9215-7a6af5c842e0 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:46.645447 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9df5ef74-527f-4ca6-9215-7a6af5c842e0 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:46.648780 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=75 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:16:46.778489 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-9df5ef74-527f-4ca6-9215-7a6af5c842e0 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d237fbcac466cadbccce06ab883b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa652e067e840f1a4fee76614648726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:16:46.786851 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-9df5ef74-527f-4ca6-9215-7a6af5c842e0 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] 10.222.0.58 "GET /compute/v2.1/servers/e3c1b762-aa16-48ce-bf27-9c570172ab04" status: 200 len: 1314 microversion: 2.1 time: 0.165117 Aug 31 13:16:46.787428 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 502/1029] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:16:46 2022] GET /compute/v2.1/servers/e3c1b762-aa16-48ce-bf27-9c570172ab04 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:16:47.811434 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-d1540074-7e15-488d-80f9-2b0be1b62767 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:16:47.812257 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-d1540074-7e15-488d-80f9-2b0be1b62767 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] [instance: e3c1b762-aa16-48ce-bf27-9c570172ab04] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:16:47.815991 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell0:SELECT=10 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:16:47.817076 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:16:47.823001 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d1540074-7e15-488d-80f9-2b0be1b62767 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:47.823477 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d1540074-7e15-488d-80f9-2b0be1b62767 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:47.823928 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d1540074-7e15-488d-80f9-2b0be1b62767 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:47.824623 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d1540074-7e15-488d-80f9-2b0be1b62767 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:47.825064 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d1540074-7e15-488d-80f9-2b0be1b62767 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:47.825479 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d1540074-7e15-488d-80f9-2b0be1b62767 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:47.828748 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:16:47.970889 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-d1540074-7e15-488d-80f9-2b0be1b62767 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d237fbcac466cadbccce06ab883b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa652e067e840f1a4fee76614648726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:16:47.979180 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-d1540074-7e15-488d-80f9-2b0be1b62767 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] 10.222.0.58 "GET /compute/v2.1/servers/e3c1b762-aa16-48ce-bf27-9c570172ab04" status: 200 len: 1314 microversion: 2.1 time: 0.174245 Aug 31 13:16:47.980010 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 528/1030] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:16:47 2022] GET /compute/v2.1/servers/e3c1b762-aa16-48ce-bf27-9c570172ab04 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:16:48.034646 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-e1ddabe0-58a9-4579-86ef-582954cab1c9 req-644242ea-c054-439f-bd26-9b1f37aa5611 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3c1b762-aa16-48ce-bf27-9c570172ab04", "name": "network-vif-plugged", "status": "completed", "tag": "33e68ffa-bab7-4a15-a71b-6ba45c52062a"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:16:48.045350 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-e1ddabe0-58a9-4579-86ef-582954cab1c9 req-644242ea-c054-439f-bd26-9b1f37aa5611 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:48.045825 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-e1ddabe0-58a9-4579-86ef-582954cab1c9 req-644242ea-c054-439f-bd26-9b1f37aa5611 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:48.046430 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-e1ddabe0-58a9-4579-86ef-582954cab1c9 req-644242ea-c054-439f-bd26-9b1f37aa5611 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:48.057795 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-e1ddabe0-58a9-4579-86ef-582954cab1c9 req-644242ea-c054-439f-bd26-9b1f37aa5611 service nova] Creating event network-vif-plugged:33e68ffa-bab7-4a15-a71b-6ba45c52062a for instance e3c1b762-aa16-48ce-bf27-9c570172ab04 on hv-cinder-85442 Aug 31 13:16:48.062830 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-e1ddabe0-58a9-4579-86ef-582954cab1c9 req-644242ea-c054-439f-bd26-9b1f37aa5611 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031832 Aug 31 13:16:48.063318 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 503/1031] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:16:49.004881 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-d98d887d-1f19-4675-b0e1-5e59f4a20c30 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:16:49.005976 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-d98d887d-1f19-4675-b0e1-5e59f4a20c30 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] [instance: e3c1b762-aa16-48ce-bf27-9c570172ab04] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:16:49.018367 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d98d887d-1f19-4675-b0e1-5e59f4a20c30 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:49.019115 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d98d887d-1f19-4675-b0e1-5e59f4a20c30 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:49.019877 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d98d887d-1f19-4675-b0e1-5e59f4a20c30 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:49.021092 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d98d887d-1f19-4675-b0e1-5e59f4a20c30 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:49.022193 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d98d887d-1f19-4675-b0e1-5e59f4a20c30 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:49.022609 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d98d887d-1f19-4675-b0e1-5e59f4a20c30 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:49.166269 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-d98d887d-1f19-4675-b0e1-5e59f4a20c30 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d237fbcac466cadbccce06ab883b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa652e067e840f1a4fee76614648726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:16:49.174485 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-d98d887d-1f19-4675-b0e1-5e59f4a20c30 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] 10.222.0.58 "GET /compute/v2.1/servers/e3c1b762-aa16-48ce-bf27-9c570172ab04" status: 200 len: 1314 microversion: 2.1 time: 0.176278 Aug 31 13:16:49.175065 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 529/1032] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:16:48 2022] GET /compute/v2.1/servers/e3c1b762-aa16-48ce-bf27-9c570172ab04 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:16:50.200251 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-a7b2c756-c9e9-4407-aedb-19db4b7584e4 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:16:50.200920 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-a7b2c756-c9e9-4407-aedb-19db4b7584e4 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] [instance: e3c1b762-aa16-48ce-bf27-9c570172ab04] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:16:50.208375 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a7b2c756-c9e9-4407-aedb-19db4b7584e4 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:50.208899 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a7b2c756-c9e9-4407-aedb-19db4b7584e4 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:50.209379 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a7b2c756-c9e9-4407-aedb-19db4b7584e4 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:50.210137 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a7b2c756-c9e9-4407-aedb-19db4b7584e4 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:50.210635 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a7b2c756-c9e9-4407-aedb-19db4b7584e4 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:50.211099 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a7b2c756-c9e9-4407-aedb-19db4b7584e4 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:50.340905 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-a7b2c756-c9e9-4407-aedb-19db4b7584e4 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d237fbcac466cadbccce06ab883b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa652e067e840f1a4fee76614648726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:16:50.349494 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-a7b2c756-c9e9-4407-aedb-19db4b7584e4 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] 10.222.0.58 "GET /compute/v2.1/servers/e3c1b762-aa16-48ce-bf27-9c570172ab04" status: 200 len: 1499 microversion: 2.1 time: 0.156182 Aug 31 13:16:50.350113 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 504/1033] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:16:50 2022] GET /compute/v2.1/servers/e3c1b762-aa16-48ce-bf27-9c570172ab04 => generated 1499 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:16:50.957002 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-d407f3bf-7f49-4a6e-844b-c9f1d9950def tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:16:50.957470 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-d407f3bf-7f49-4a6e-844b-c9f1d9950def tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] [instance: e3c1b762-aa16-48ce-bf27-9c570172ab04] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:16:50.964542 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d407f3bf-7f49-4a6e-844b-c9f1d9950def tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:50.965019 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d407f3bf-7f49-4a6e-844b-c9f1d9950def tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:50.965445 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d407f3bf-7f49-4a6e-844b-c9f1d9950def tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:50.966131 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d407f3bf-7f49-4a6e-844b-c9f1d9950def tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:50.966573 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d407f3bf-7f49-4a6e-844b-c9f1d9950def tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:50.966990 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d407f3bf-7f49-4a6e-844b-c9f1d9950def tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:50.992905 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-d407f3bf-7f49-4a6e-844b-c9f1d9950def tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] [instance: e3c1b762-aa16-48ce-bf27-9c570172ab04] Going to try to terminate instance {{(pid=120704) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 13:16:51.095302 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-d407f3bf-7f49-4a6e-844b-c9f1d9950def tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e3c1b762-aa16-48ce-bf27-9c570172ab04" status: 204 len: 0 microversion: 2.1 time: 0.141901 Aug 31 13:16:51.096009 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 530/1034] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 31 13:16:50 2022] DELETE /compute/v2.1/servers/e3c1b762-aa16-48ce-bf27-9c570172ab04 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:16:51.104386 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-a50acc20-36c4-434a-a9fe-651d2630a392 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:16:51.105084 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-a50acc20-36c4-434a-a9fe-651d2630a392 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] [instance: e3c1b762-aa16-48ce-bf27-9c570172ab04] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:16:51.111401 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a50acc20-36c4-434a-a9fe-651d2630a392 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:51.112048 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a50acc20-36c4-434a-a9fe-651d2630a392 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:51.112540 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a50acc20-36c4-434a-a9fe-651d2630a392 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:51.113434 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a50acc20-36c4-434a-a9fe-651d2630a392 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:51.113962 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a50acc20-36c4-434a-a9fe-651d2630a392 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:51.114360 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a50acc20-36c4-434a-a9fe-651d2630a392 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:51.251265 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-a50acc20-36c4-434a-a9fe-651d2630a392 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d237fbcac466cadbccce06ab883b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa652e067e840f1a4fee76614648726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:16:51.263524 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-a50acc20-36c4-434a-a9fe-651d2630a392 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] 10.222.0.58 "GET /compute/v2.1/servers/e3c1b762-aa16-48ce-bf27-9c570172ab04" status: 200 len: 1505 microversion: 2.1 time: 0.162856 Aug 31 13:16:51.264445 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 505/1035] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:16:51 2022] GET /compute/v2.1/servers/e3c1b762-aa16-48ce-bf27-9c570172ab04 => generated 1505 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:16:52.294811 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-f5040935-61cb-4a6d-be15-7f28e3849e8a tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:16:52.295663 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-f5040935-61cb-4a6d-be15-7f28e3849e8a tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] [instance: e3c1b762-aa16-48ce-bf27-9c570172ab04] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:16:52.304589 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f5040935-61cb-4a6d-be15-7f28e3849e8a tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:52.305217 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f5040935-61cb-4a6d-be15-7f28e3849e8a tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:52.305784 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f5040935-61cb-4a6d-be15-7f28e3849e8a tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:52.306691 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f5040935-61cb-4a6d-be15-7f28e3849e8a tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:52.307351 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f5040935-61cb-4a6d-be15-7f28e3849e8a tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:52.307988 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f5040935-61cb-4a6d-be15-7f28e3849e8a tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:52.453806 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-f5040935-61cb-4a6d-be15-7f28e3849e8a tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d237fbcac466cadbccce06ab883b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa652e067e840f1a4fee76614648726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:16:52.462261 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-f5040935-61cb-4a6d-be15-7f28e3849e8a tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] 10.222.0.58 "GET /compute/v2.1/servers/e3c1b762-aa16-48ce-bf27-9c570172ab04" status: 200 len: 1505 microversion: 2.1 time: 0.174407 Aug 31 13:16:52.462842 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 531/1036] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:16:52 2022] GET /compute/v2.1/servers/e3c1b762-aa16-48ce-bf27-9c570172ab04 => generated 1505 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:16:53.484187 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-63d06f59-deb2-44a6-9233-21ece45cfbea tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:16:53.484941 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-63d06f59-deb2-44a6-9233-21ece45cfbea tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] [instance: e3c1b762-aa16-48ce-bf27-9c570172ab04] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:16:53.491596 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-63d06f59-deb2-44a6-9233-21ece45cfbea tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:53.492120 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-63d06f59-deb2-44a6-9233-21ece45cfbea tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:53.492554 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-63d06f59-deb2-44a6-9233-21ece45cfbea tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:53.493250 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-63d06f59-deb2-44a6-9233-21ece45cfbea tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:53.493699 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-63d06f59-deb2-44a6-9233-21ece45cfbea tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:53.494141 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-63d06f59-deb2-44a6-9233-21ece45cfbea tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:53.632132 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-63d06f59-deb2-44a6-9233-21ece45cfbea tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d237fbcac466cadbccce06ab883b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa652e067e840f1a4fee76614648726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:16:53.640355 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-63d06f59-deb2-44a6-9233-21ece45cfbea tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] 10.222.0.58 "GET /compute/v2.1/servers/e3c1b762-aa16-48ce-bf27-9c570172ab04" status: 200 len: 1505 microversion: 2.1 time: 0.160390 Aug 31 13:16:53.640934 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 506/1037] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:16:53 2022] GET /compute/v2.1/servers/e3c1b762-aa16-48ce-bf27-9c570172ab04 => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:16:53.709013 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-37329441-3e5a-4f97-981e-5089ee56b8c8 req-942e14ce-8b05-46d2-b99b-59ef5eed53fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3c1b762-aa16-48ce-bf27-9c570172ab04", "name": "network-vif-deleted", "tag": "33e68ffa-bab7-4a15-a71b-6ba45c52062a"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:16:53.719633 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-37329441-3e5a-4f97-981e-5089ee56b8c8 req-942e14ce-8b05-46d2-b99b-59ef5eed53fd service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:53.720153 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-37329441-3e5a-4f97-981e-5089ee56b8c8 req-942e14ce-8b05-46d2-b99b-59ef5eed53fd service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:53.720576 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-37329441-3e5a-4f97-981e-5089ee56b8c8 req-942e14ce-8b05-46d2-b99b-59ef5eed53fd service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:53.732186 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-37329441-3e5a-4f97-981e-5089ee56b8c8 req-942e14ce-8b05-46d2-b99b-59ef5eed53fd service nova] Creating event network-vif-deleted:33e68ffa-bab7-4a15-a71b-6ba45c52062a for instance e3c1b762-aa16-48ce-bf27-9c570172ab04 on hv-cinder-85442 Aug 31 13:16:53.737196 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-37329441-3e5a-4f97-981e-5089ee56b8c8 req-942e14ce-8b05-46d2-b99b-59ef5eed53fd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031899 Aug 31 13:16:53.737797 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 532/1038] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:16:54.662243 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-7a501d8f-add1-4920-9a0a-ab34158917d2 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:16:54.662888 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-7a501d8f-add1-4920-9a0a-ab34158917d2 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] [instance: e3c1b762-aa16-48ce-bf27-9c570172ab04] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:16:54.669995 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7a501d8f-add1-4920-9a0a-ab34158917d2 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:54.670477 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7a501d8f-add1-4920-9a0a-ab34158917d2 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:54.670915 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7a501d8f-add1-4920-9a0a-ab34158917d2 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:54.671608 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7a501d8f-add1-4920-9a0a-ab34158917d2 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:16:54.672095 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7a501d8f-add1-4920-9a0a-ab34158917d2 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:16:54.672526 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7a501d8f-add1-4920-9a0a-ab34158917d2 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:16:54.686757 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-7a501d8f-add1-4920-9a0a-ab34158917d2 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] HTTP exception thrown: Instance e3c1b762-aa16-48ce-bf27-9c570172ab04 could not be found. Aug 31 13:16:54.688785 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-7a501d8f-add1-4920-9a0a-ab34158917d2 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Request method failure captured: Aug 31 13:16:54.688785 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: request: GET /compute/v2.1/servers/e3c1b762-aa16-48ce-bf27-9c570172ab04 HTTP/1.1 Aug 31 13:16:54.688785 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 31 13:16:54.688785 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 31 13:16:54.688785 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Connection: close Aug 31 13:16:54.688785 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 31 13:16:54.688785 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 31 13:16:54.688785 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Host: 10.222.0.58 Aug 31 13:16:54.688785 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 31 13:16:54.688785 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 31 13:16:54.688785 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjD18dPvda-L_Mv487vhQW-2HQbVvxr30NR1Hyjtco8SZntUjrsTFg8SVvkZvwm7D_ipQe9SPWcpqSHKaivfYzj0kLjZywpjRJnrekFPLw7aDrO6ABi-OQPcKWs6VNKvqggF3RlhynFKLNTcRwCWCKE5jE56zLk0JyxGaK6jkGlomAUEQ Aug 31 13:16:54.688785 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 31 13:16:54.688785 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 31 13:16:54.688785 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 31 13:16:54.688785 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 31 13:16:54.688785 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 31 13:16:54.688785 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 31 13:16:54.688785 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Id: efa652e067e840f1a4fee76614648726 Aug 31 13:16:54.688785 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-VolumesActionsTest-1863774945 Aug 31 13:16:54.688785 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Role: member,reader Aug 31 13:16:54.688785 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Roles: member,reader Aug 31 13:16:54.690651 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_efa652e067e840f1a4fee76614648726"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/efa652e067e840f1a4fee76614648726"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/efa652e067e840f1a4fee76614648726"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/efa652e067e840f1a4fee76614648726"}]}] Aug 31 13:16:54.690651 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-VolumesActionsTest-1863774945 Aug 31 13:16:54.690651 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant-Id: efa652e067e840f1a4fee76614648726 Aug 31 13:16:54.690651 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-VolumesActionsTest-1863774945 Aug 31 13:16:54.690651 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User: tempest-VolumesActionsTest-1863774945-project Aug 31 13:16:54.690651 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 31 13:16:54.690651 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 31 13:16:54.690651 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Id: be2d237fbcac466cadbccce06ab883b6 Aug 31 13:16:54.690651 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-VolumesActionsTest-1863774945-project Aug 31 13:16:54.690651 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: method: > Aug 31 13:16:54.690651 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: exception: Instance e3c1b762-aa16-48ce-bf27-9c570172ab04 could not be found. Aug 31 13:16:54.690651 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: action_args: {'id': 'e3c1b762-aa16-48ce-bf27-9c570172ab04'} Aug 31 13:16:54.692248 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:16:54.692248 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:16:54.692248 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 13:16:54.692248 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 13:16:54.692248 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 13:16:54.692248 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 13:16:54.692248 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 13:16:54.692248 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 13:16:54.692248 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 13:16:54.692248 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 13:16:54.692248 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3c1b762-aa16-48ce-bf27-9c570172ab04 could not be found. Aug 31 13:16:54.692248 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:16:54.692248 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:16:54.692248 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:16:54.692248 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:16:54.692248 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:16:54.692248 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:16:54.692248 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:16:54.692248 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:16:54.692248 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:16:54.693759 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:16:54.693759 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 13:16:54.693759 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 13:16:54.693759 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 13:16:54.693759 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 13:16:54.693759 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 13:16:54.693759 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 13:16:54.693759 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3c1b762-aa16-48ce-bf27-9c570172ab04 could not be found. Aug 31 13:16:54.693759 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:16:54.693759 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:16:54.693759 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:16:54.693759 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:16:54.693759 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:16:54.693759 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:16:54.693759 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:16:54.693759 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:16:54.693759 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3c1b762-aa16-48ce-bf27-9c570172ab04 could not be found. Aug 31 13:16:54.693759 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:16:54.695221 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-7a501d8f-add1-4920-9a0a-ab34158917d2 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] Returning 404 to user: Instance e3c1b762-aa16-48ce-bf27-9c570172ab04 could not be found. {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:16:54.695221 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-7a501d8f-add1-4920-9a0a-ab34158917d2 tempest-VolumesActionsTest-1863774945 tempest-VolumesActionsTest-1863774945-project] 10.222.0.58 "GET /compute/v2.1/servers/e3c1b762-aa16-48ce-bf27-9c570172ab04" status: 404 len: 111 microversion: 2.1 time: 0.032233 Aug 31 13:16:54.695221 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 507/1039] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:16:54 2022] GET /compute/v2.1/servers/e3c1b762-aa16-48ce-bf27-9c570172ab04 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:17:38.839231 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:17:38.840085 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:17:38.845852 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-944498ce-cf17-41db-bca4-e29226cc475d tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Action: 'create', calling method: .version_select at 0x7f19527de5e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-889018827", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATgiadgjJ5NutT7sCxLDysI4yhSV308h9EF7k75gly+8ENbV/8zpaI1+wMUAgO0CclzjJ0XM1X2tM+gKOW65IfWIVjxZyrpJLBZayMz62i+/J2FASA86tvz6h/Q2D7nHg=="}} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:17:38.865361 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.quota [None req-944498ce-cf17-41db-bca4-e29226cc475d tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Getting quotas for project ed119c3fb6874ad3bc5caaa6a78288a5. Resources: {'key_pairs'} {{(pid=120704) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 13:17:38.869496 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.quota [None req-944498ce-cf17-41db-bca4-e29226cc475d tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Getting quotas for user 91e284876d9f483a855b382e6ac7ee82 and project ed119c3fb6874ad3bc5caaa6a78288a5. Resources: {'key_pairs'} {{(pid=120704) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 13:17:38.893217 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-944498ce-cf17-41db-bca4-e29226cc475d tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.055658 Aug 31 13:17:38.893826 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 533/1040] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 31 13:17:38 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:17:38.946128 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-1ab711c5-a3cf-4821-a929-c679c6c2209d tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-404905295", "imageRef": "d42d921e-aafc-47b9-b91f-d1a860f8d833", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-889018827", "networks": [{"uuid": "38388198-a2cd-496a-b06b-72404376c7e7"}]}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:17:38.955025 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=11 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:17:38.955609 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=27 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:17:39.004222 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.network.neutron [None req-1ab711c5-a3cf-4821-a929-c679c6c2209d tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] validate_networks() for [('38388198-a2cd-496a-b06b-72404376c7e7', None, None, None, None, None)] {{(pid=120705) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 13:17:39.496186 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-1ab711c5-a3cf-4821-a929-c679c6c2209d tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Flavor limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 13:17:39.496633 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-1ab711c5-a3cf-4821-a929-c679c6c2209d tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Image limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 13:17:39.497136 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-1ab711c5-a3cf-4821-a929-c679c6c2209d tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Flavor pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 13:17:39.497537 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-1ab711c5-a3cf-4821-a929-c679c6c2209d tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Image pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 13:17:39.497946 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-1ab711c5-a3cf-4821-a929-c679c6c2209d tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 13:17:39.506914 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1ab711c5-a3cf-4821-a929-c679c6c2209d tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:17:39.507396 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1ab711c5-a3cf-4821-a929-c679c6c2209d tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:17:39.507846 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1ab711c5-a3cf-4821-a929-c679c6c2209d tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:17:39.508573 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1ab711c5-a3cf-4821-a929-c679c6c2209d tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:17:39.509023 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1ab711c5-a3cf-4821-a929-c679c6c2209d tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:17:39.509439 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1ab711c5-a3cf-4821-a929-c679c6c2209d tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:17:39.526789 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-1ab711c5-a3cf-4821-a929-c679c6c2209d tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Getting quotas for project ed119c3fb6874ad3bc5caaa6a78288a5. Resources: {'instances', 'ram', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 13:17:39.533182 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-1ab711c5-a3cf-4821-a929-c679c6c2209d tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Getting quotas for user 91e284876d9f483a855b382e6ac7ee82 and project ed119c3fb6874ad3bc5caaa6a78288a5. Resources: {'instances', 'ram', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 13:17:39.546016 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-1ab711c5-a3cf-4821-a929-c679c6c2209d tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Going to run 1 instances... {{(pid=120705) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 13:17:39.548633 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-1ab711c5-a3cf-4821-a929-c679c6c2209d tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d42d921e-aafc-47b9-b91f-d1a860f8d833',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120705) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 13:17:39.610926 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-1ab711c5-a3cf-4821-a929-c679c6c2209d tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.669020 Aug 31 13:17:39.611605 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 508/1041] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 31 13:17:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 13:17:39.624192 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-177d0fe2-07b0-4348-8d50-41c8d7d79529 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:17:39.625098 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-177d0fe2-07b0-4348-8d50-41c8d7d79529 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:17:39.682664 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-177d0fe2-07b0-4348-8d50-41c8d7d79529 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e284876d9f483a855b382e6ac7ee82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed119c3fb6874ad3bc5caaa6a78288a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:17:39.690619 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-177d0fe2-07b0-4348-8d50-41c8d7d79529 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa" status: 200 len: 1257 microversion: 2.1 time: 0.071965 Aug 31 13:17:39.691189 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 534/1042] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:17:39 2022] GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa => generated 1257 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:17:40.712722 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-7d250a6f-5e81-4c34-8b9a-0782211bd6dd tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:17:40.713348 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-7d250a6f-5e81-4c34-8b9a-0782211bd6dd tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:17:40.722116 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7d250a6f-5e81-4c34-8b9a-0782211bd6dd tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:17:40.722593 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7d250a6f-5e81-4c34-8b9a-0782211bd6dd tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:17:40.723017 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7d250a6f-5e81-4c34-8b9a-0782211bd6dd tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:17:40.723698 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7d250a6f-5e81-4c34-8b9a-0782211bd6dd tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:17:40.724187 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7d250a6f-5e81-4c34-8b9a-0782211bd6dd tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:17:40.724603 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-7d250a6f-5e81-4c34-8b9a-0782211bd6dd tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:17:40.789529 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-7d250a6f-5e81-4c34-8b9a-0782211bd6dd tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e284876d9f483a855b382e6ac7ee82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed119c3fb6874ad3bc5caaa6a78288a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:17:40.798593 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-7d250a6f-5e81-4c34-8b9a-0782211bd6dd tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa" status: 200 len: 1309 microversion: 2.1 time: 0.090568 Aug 31 13:17:40.799163 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 509/1043] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:17:40 2022] GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa => generated 1309 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:17:41.819357 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-34c02e71-ac97-4f34-b8a7-85e57b5856d2 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:17:41.820584 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-34c02e71-ac97-4f34-b8a7-85e57b5856d2 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:17:41.827428 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-34c02e71-ac97-4f34-b8a7-85e57b5856d2 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:17:41.828203 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-34c02e71-ac97-4f34-b8a7-85e57b5856d2 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:17:41.828816 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-34c02e71-ac97-4f34-b8a7-85e57b5856d2 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:17:41.832762 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-34c02e71-ac97-4f34-b8a7-85e57b5856d2 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:17:41.833239 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-34c02e71-ac97-4f34-b8a7-85e57b5856d2 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:17:41.833668 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-34c02e71-ac97-4f34-b8a7-85e57b5856d2 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:17:41.988826 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-34c02e71-ac97-4f34-b8a7-85e57b5856d2 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e284876d9f483a855b382e6ac7ee82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed119c3fb6874ad3bc5caaa6a78288a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:17:41.997549 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-34c02e71-ac97-4f34-b8a7-85e57b5856d2 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa" status: 200 len: 1357 microversion: 2.1 time: 0.182764 Aug 31 13:17:41.998160 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 535/1044] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:17:41 2022] GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:17:43.018995 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b15bfef0-d4c5-4fad-b0bf-4a7a91b5d347 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:17:43.019635 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b15bfef0-d4c5-4fad-b0bf-4a7a91b5d347 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:17:43.028258 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b15bfef0-d4c5-4fad-b0bf-4a7a91b5d347 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:17:43.029340 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b15bfef0-d4c5-4fad-b0bf-4a7a91b5d347 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:17:43.030004 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b15bfef0-d4c5-4fad-b0bf-4a7a91b5d347 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:17:43.031094 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b15bfef0-d4c5-4fad-b0bf-4a7a91b5d347 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:17:43.031717 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b15bfef0-d4c5-4fad-b0bf-4a7a91b5d347 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:17:43.032988 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b15bfef0-d4c5-4fad-b0bf-4a7a91b5d347 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:17:43.177013 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-b15bfef0-d4c5-4fad-b0bf-4a7a91b5d347 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e284876d9f483a855b382e6ac7ee82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed119c3fb6874ad3bc5caaa6a78288a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:17:43.185930 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b15bfef0-d4c5-4fad-b0bf-4a7a91b5d347 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa" status: 200 len: 1357 microversion: 2.1 time: 0.170987 Aug 31 13:17:43.187327 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 510/1045] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:17:43 2022] GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:17:44.207960 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-ec3fb7ff-4a76-4013-bda2-437fe84ccb7f tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:17:44.208616 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-ec3fb7ff-4a76-4013-bda2-437fe84ccb7f tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:17:44.215427 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ec3fb7ff-4a76-4013-bda2-437fe84ccb7f tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:17:44.216283 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ec3fb7ff-4a76-4013-bda2-437fe84ccb7f tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:17:44.216947 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ec3fb7ff-4a76-4013-bda2-437fe84ccb7f tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:17:44.217696 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ec3fb7ff-4a76-4013-bda2-437fe84ccb7f tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:17:44.218219 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ec3fb7ff-4a76-4013-bda2-437fe84ccb7f tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:17:44.218722 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ec3fb7ff-4a76-4013-bda2-437fe84ccb7f tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:17:44.379044 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-ec3fb7ff-4a76-4013-bda2-437fe84ccb7f tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e284876d9f483a855b382e6ac7ee82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed119c3fb6874ad3bc5caaa6a78288a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:17:44.388152 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-ec3fb7ff-4a76-4013-bda2-437fe84ccb7f tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa" status: 200 len: 1357 microversion: 2.1 time: 0.184411 Aug 31 13:17:44.388741 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 536/1046] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:17:44 2022] GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa => generated 1357 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:17:45.414341 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-0b38b758-1f49-4a9c-97b6-d91bde396e9c tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:17:45.415117 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-0b38b758-1f49-4a9c-97b6-d91bde396e9c tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:17:45.422365 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0b38b758-1f49-4a9c-97b6-d91bde396e9c tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:17:45.422846 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0b38b758-1f49-4a9c-97b6-d91bde396e9c tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:17:45.423278 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0b38b758-1f49-4a9c-97b6-d91bde396e9c tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:17:45.424021 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0b38b758-1f49-4a9c-97b6-d91bde396e9c tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:17:45.424469 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0b38b758-1f49-4a9c-97b6-d91bde396e9c tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:17:45.424888 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0b38b758-1f49-4a9c-97b6-d91bde396e9c tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:17:45.620619 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-0b38b758-1f49-4a9c-97b6-d91bde396e9c tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e284876d9f483a855b382e6ac7ee82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed119c3fb6874ad3bc5caaa6a78288a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:17:45.638371 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-0b38b758-1f49-4a9c-97b6-d91bde396e9c tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa" status: 200 len: 1357 microversion: 2.1 time: 0.228430 Aug 31 13:17:45.639282 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 511/1047] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:17:45 2022] GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa => generated 1357 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:17:46.661746 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-f770a615-9bda-41cc-bd12-3f7a5b12208b tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:17:46.662570 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-f770a615-9bda-41cc-bd12-3f7a5b12208b tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:17:46.671424 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f770a615-9bda-41cc-bd12-3f7a5b12208b tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:17:46.671943 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f770a615-9bda-41cc-bd12-3f7a5b12208b tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:17:46.672378 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f770a615-9bda-41cc-bd12-3f7a5b12208b tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:17:46.673107 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f770a615-9bda-41cc-bd12-3f7a5b12208b tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:17:46.673575 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f770a615-9bda-41cc-bd12-3f7a5b12208b tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:17:46.673992 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-f770a615-9bda-41cc-bd12-3f7a5b12208b tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:17:46.831572 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-f770a615-9bda-41cc-bd12-3f7a5b12208b tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e284876d9f483a855b382e6ac7ee82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed119c3fb6874ad3bc5caaa6a78288a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:17:46.839864 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-f770a615-9bda-41cc-bd12-3f7a5b12208b tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa" status: 200 len: 1357 microversion: 2.1 time: 0.182342 Aug 31 13:17:46.840589 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 537/1048] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:17:46 2022] GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:17:47.861072 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-860fb3f9-8ddc-4042-bc02-fc60af47695c tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:17:47.862799 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-860fb3f9-8ddc-4042-bc02-fc60af47695c tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:17:47.870227 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-860fb3f9-8ddc-4042-bc02-fc60af47695c tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:17:47.870716 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-860fb3f9-8ddc-4042-bc02-fc60af47695c tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:17:47.871150 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-860fb3f9-8ddc-4042-bc02-fc60af47695c tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:17:47.871952 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-860fb3f9-8ddc-4042-bc02-fc60af47695c tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:17:47.872428 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-860fb3f9-8ddc-4042-bc02-fc60af47695c tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:17:47.872902 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-860fb3f9-8ddc-4042-bc02-fc60af47695c tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:17:48.014830 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-860fb3f9-8ddc-4042-bc02-fc60af47695c tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e284876d9f483a855b382e6ac7ee82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed119c3fb6874ad3bc5caaa6a78288a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:17:48.023380 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-860fb3f9-8ddc-4042-bc02-fc60af47695c tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa" status: 200 len: 1357 microversion: 2.1 time: 0.166291 Aug 31 13:17:48.024179 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 512/1049] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:17:47 2022] GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:17:49.047087 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-021778b1-aac0-4d4e-aa81-8ed23d32e53d tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:17:49.047691 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-021778b1-aac0-4d4e-aa81-8ed23d32e53d tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:17:49.054855 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-021778b1-aac0-4d4e-aa81-8ed23d32e53d tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:17:49.055337 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-021778b1-aac0-4d4e-aa81-8ed23d32e53d tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:17:49.055768 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-021778b1-aac0-4d4e-aa81-8ed23d32e53d tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:17:49.056475 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-021778b1-aac0-4d4e-aa81-8ed23d32e53d tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:17:49.056901 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-021778b1-aac0-4d4e-aa81-8ed23d32e53d tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:17:49.057343 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-021778b1-aac0-4d4e-aa81-8ed23d32e53d tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:17:49.192909 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-021778b1-aac0-4d4e-aa81-8ed23d32e53d tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e284876d9f483a855b382e6ac7ee82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed119c3fb6874ad3bc5caaa6a78288a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:17:49.204926 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-021778b1-aac0-4d4e-aa81-8ed23d32e53d tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa" status: 200 len: 1357 microversion: 2.1 time: 0.163104 Aug 31 13:17:49.205689 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 538/1050] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:17:49 2022] GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:17:50.234108 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b46719ad-413b-4d3e-9acf-d2e36b8eb86e tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:17:50.234837 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b46719ad-413b-4d3e-9acf-d2e36b8eb86e tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:17:50.237889 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=2 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:17:50.238715 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=6 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:17:50.247130 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b46719ad-413b-4d3e-9acf-d2e36b8eb86e tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:17:50.247715 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b46719ad-413b-4d3e-9acf-d2e36b8eb86e tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:17:50.248491 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b46719ad-413b-4d3e-9acf-d2e36b8eb86e tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:17:50.249740 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b46719ad-413b-4d3e-9acf-d2e36b8eb86e tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:17:50.250456 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b46719ad-413b-4d3e-9acf-d2e36b8eb86e tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:17:50.250990 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b46719ad-413b-4d3e-9acf-d2e36b8eb86e tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:17:50.397397 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-b46719ad-413b-4d3e-9acf-d2e36b8eb86e tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e284876d9f483a855b382e6ac7ee82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed119c3fb6874ad3bc5caaa6a78288a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:17:50.410772 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b46719ad-413b-4d3e-9acf-d2e36b8eb86e tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa" status: 200 len: 1357 microversion: 2.1 time: 0.182748 Aug 31 13:17:50.411684 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 513/1051] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:17:50 2022] GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:17:51.439342 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-ea186c87-4d66-47b7-b5d6-80f4179a8073 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:17:51.440461 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-ea186c87-4d66-47b7-b5d6-80f4179a8073 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:17:51.443314 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell0:SELECT=6 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:17:51.453778 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ea186c87-4d66-47b7-b5d6-80f4179a8073 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:17:51.454560 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ea186c87-4d66-47b7-b5d6-80f4179a8073 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:17:51.455272 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ea186c87-4d66-47b7-b5d6-80f4179a8073 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:17:51.456443 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ea186c87-4d66-47b7-b5d6-80f4179a8073 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:17:51.457199 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ea186c87-4d66-47b7-b5d6-80f4179a8073 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:17:51.457886 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ea186c87-4d66-47b7-b5d6-80f4179a8073 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:17:51.601185 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-ea186c87-4d66-47b7-b5d6-80f4179a8073 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e284876d9f483a855b382e6ac7ee82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed119c3fb6874ad3bc5caaa6a78288a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:17:51.613089 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-ea186c87-4d66-47b7-b5d6-80f4179a8073 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa" status: 200 len: 1357 microversion: 2.1 time: 0.180078 Aug 31 13:17:51.613857 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 539/1052] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:17:51 2022] GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa => generated 1357 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:17:52.634983 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-4fdc09e6-d262-4df2-b8fc-0047b52d7e7f tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:17:52.635620 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-4fdc09e6-d262-4df2-b8fc-0047b52d7e7f tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:17:52.642768 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4fdc09e6-d262-4df2-b8fc-0047b52d7e7f tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:17:52.643253 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4fdc09e6-d262-4df2-b8fc-0047b52d7e7f tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:17:52.643686 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4fdc09e6-d262-4df2-b8fc-0047b52d7e7f tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:17:52.644409 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4fdc09e6-d262-4df2-b8fc-0047b52d7e7f tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:17:52.644860 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4fdc09e6-d262-4df2-b8fc-0047b52d7e7f tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:17:52.645280 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4fdc09e6-d262-4df2-b8fc-0047b52d7e7f tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:17:52.783540 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-4fdc09e6-d262-4df2-b8fc-0047b52d7e7f tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e284876d9f483a855b382e6ac7ee82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed119c3fb6874ad3bc5caaa6a78288a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:17:52.787857 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-2b360160-e90b-415f-b3a8-dc1b981ad2f2 req-1cf0acc0-98bf-4141-8427-26da7e8b276d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e6b5882-44a3-458e-9cf5-6a47e6832ffa", "tag": "e5fafc0e-5dd3-4edf-aa02-6c2a7a309f7f"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:17:52.792080 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-4fdc09e6-d262-4df2-b8fc-0047b52d7e7f tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa" status: 200 len: 1357 microversion: 2.1 time: 0.160951 Aug 31 13:17:52.798819 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-2b360160-e90b-415f-b3a8-dc1b981ad2f2 req-1cf0acc0-98bf-4141-8427-26da7e8b276d service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:17:52.799303 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-2b360160-e90b-415f-b3a8-dc1b981ad2f2 req-1cf0acc0-98bf-4141-8427-26da7e8b276d service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:17:52.799726 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-2b360160-e90b-415f-b3a8-dc1b981ad2f2 req-1cf0acc0-98bf-4141-8427-26da7e8b276d service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:17:52.805198 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 514/1053] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:17:52 2022] GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:17:52.812542 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-2b360160-e90b-415f-b3a8-dc1b981ad2f2 req-1cf0acc0-98bf-4141-8427-26da7e8b276d service nova] Creating event network-changed:e5fafc0e-5dd3-4edf-aa02-6c2a7a309f7f for instance 5e6b5882-44a3-458e-9cf5-6a47e6832ffa on hv-cinder-85442 Aug 31 13:17:52.817484 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-2b360160-e90b-415f-b3a8-dc1b981ad2f2 req-1cf0acc0-98bf-4141-8427-26da7e8b276d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033428 Aug 31 13:17:52.818192 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 540/1054] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:17:53.818814 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-8cc185e1-7d55-4fda-bd37-795acd7aa9de tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:17:53.819865 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-8cc185e1-7d55-4fda-bd37-795acd7aa9de tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:17:53.831437 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8cc185e1-7d55-4fda-bd37-795acd7aa9de tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:17:53.832292 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8cc185e1-7d55-4fda-bd37-795acd7aa9de tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:17:53.833013 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8cc185e1-7d55-4fda-bd37-795acd7aa9de tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:17:53.834152 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8cc185e1-7d55-4fda-bd37-795acd7aa9de tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:17:53.834900 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8cc185e1-7d55-4fda-bd37-795acd7aa9de tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:17:53.835598 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8cc185e1-7d55-4fda-bd37-795acd7aa9de tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:17:53.976455 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-8cc185e1-7d55-4fda-bd37-795acd7aa9de tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e284876d9f483a855b382e6ac7ee82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed119c3fb6874ad3bc5caaa6a78288a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:17:53.984390 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-8cc185e1-7d55-4fda-bd37-795acd7aa9de tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa" status: 200 len: 1357 microversion: 2.1 time: 0.172428 Aug 31 13:17:53.984966 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 515/1055] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:17:53 2022] GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:17:55.011490 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-7e953e75-bf52-4a86-8aea-baf34be80d7f tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:17:55.012684 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-7e953e75-bf52-4a86-8aea-baf34be80d7f tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:17:55.020428 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7e953e75-bf52-4a86-8aea-baf34be80d7f tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:17:55.020906 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7e953e75-bf52-4a86-8aea-baf34be80d7f tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:17:55.021346 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7e953e75-bf52-4a86-8aea-baf34be80d7f tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:17:55.022038 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7e953e75-bf52-4a86-8aea-baf34be80d7f tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:17:55.022485 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7e953e75-bf52-4a86-8aea-baf34be80d7f tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:17:55.022907 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7e953e75-bf52-4a86-8aea-baf34be80d7f tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:17:55.164791 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-7e953e75-bf52-4a86-8aea-baf34be80d7f tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e284876d9f483a855b382e6ac7ee82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed119c3fb6874ad3bc5caaa6a78288a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:17:55.172886 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-7e953e75-bf52-4a86-8aea-baf34be80d7f tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa" status: 200 len: 1357 microversion: 2.1 time: 0.169410 Aug 31 13:17:55.173467 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 541/1056] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:17:55 2022] GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:17:56.195740 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-8ca1424b-272b-4f9a-ab5d-fe69b75de9ab tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:17:56.196378 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-8ca1424b-272b-4f9a-ab5d-fe69b75de9ab tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:17:56.203849 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8ca1424b-272b-4f9a-ab5d-fe69b75de9ab tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:17:56.204514 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8ca1424b-272b-4f9a-ab5d-fe69b75de9ab tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:17:56.204951 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8ca1424b-272b-4f9a-ab5d-fe69b75de9ab tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:17:56.205669 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8ca1424b-272b-4f9a-ab5d-fe69b75de9ab tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:17:56.206123 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8ca1424b-272b-4f9a-ab5d-fe69b75de9ab tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:17:56.206546 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-8ca1424b-272b-4f9a-ab5d-fe69b75de9ab tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:17:56.342380 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-8ca1424b-272b-4f9a-ab5d-fe69b75de9ab tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e284876d9f483a855b382e6ac7ee82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed119c3fb6874ad3bc5caaa6a78288a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:17:56.350431 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-8ca1424b-272b-4f9a-ab5d-fe69b75de9ab tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa" status: 200 len: 1357 microversion: 2.1 time: 0.160292 Aug 31 13:17:56.351055 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 516/1057] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:17:56 2022] GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:17:57.377928 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-b22fb255-d318-448e-890f-4a0b13fd03ce tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:17:57.378526 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-b22fb255-d318-448e-890f-4a0b13fd03ce tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:17:57.385500 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b22fb255-d318-448e-890f-4a0b13fd03ce tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:17:57.385963 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b22fb255-d318-448e-890f-4a0b13fd03ce tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:17:57.386384 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b22fb255-d318-448e-890f-4a0b13fd03ce tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:17:57.387060 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b22fb255-d318-448e-890f-4a0b13fd03ce tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:17:57.387494 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b22fb255-d318-448e-890f-4a0b13fd03ce tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:17:57.387947 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b22fb255-d318-448e-890f-4a0b13fd03ce tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:17:57.525933 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-b22fb255-d318-448e-890f-4a0b13fd03ce tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e284876d9f483a855b382e6ac7ee82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed119c3fb6874ad3bc5caaa6a78288a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:17:57.534802 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-b22fb255-d318-448e-890f-4a0b13fd03ce tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa" status: 200 len: 1357 microversion: 2.1 time: 0.162973 Aug 31 13:17:57.535410 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 542/1058] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:17:57 2022] GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:17:58.557536 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-9192a6ac-8aec-4ae4-ae57-3ca5a20936ff tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:17:58.558242 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-9192a6ac-8aec-4ae4-ae57-3ca5a20936ff tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:17:58.566317 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9192a6ac-8aec-4ae4-ae57-3ca5a20936ff tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:17:58.566923 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9192a6ac-8aec-4ae4-ae57-3ca5a20936ff tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:17:58.567461 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9192a6ac-8aec-4ae4-ae57-3ca5a20936ff tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:17:58.568438 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9192a6ac-8aec-4ae4-ae57-3ca5a20936ff tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:17:58.569009 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9192a6ac-8aec-4ae4-ae57-3ca5a20936ff tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:17:58.569556 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9192a6ac-8aec-4ae4-ae57-3ca5a20936ff tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:17:58.714873 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-9192a6ac-8aec-4ae4-ae57-3ca5a20936ff tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e284876d9f483a855b382e6ac7ee82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed119c3fb6874ad3bc5caaa6a78288a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:17:58.722880 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-9192a6ac-8aec-4ae4-ae57-3ca5a20936ff tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa" status: 200 len: 1357 microversion: 2.1 time: 0.170366 Aug 31 13:17:58.723452 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 517/1059] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:17:58 2022] GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:17:59.748243 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-7f7b2e21-30c9-436b-ad77-ec232adebb21 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:17:59.749070 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-7f7b2e21-30c9-436b-ad77-ec232adebb21 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:17:59.758043 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7f7b2e21-30c9-436b-ad77-ec232adebb21 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:17:59.758518 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7f7b2e21-30c9-436b-ad77-ec232adebb21 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:17:59.758943 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7f7b2e21-30c9-436b-ad77-ec232adebb21 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:17:59.759626 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7f7b2e21-30c9-436b-ad77-ec232adebb21 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:17:59.760098 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7f7b2e21-30c9-436b-ad77-ec232adebb21 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:17:59.760508 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-7f7b2e21-30c9-436b-ad77-ec232adebb21 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:17:59.904492 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-7f7b2e21-30c9-436b-ad77-ec232adebb21 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e284876d9f483a855b382e6ac7ee82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed119c3fb6874ad3bc5caaa6a78288a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:17:59.916900 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-7f7b2e21-30c9-436b-ad77-ec232adebb21 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa" status: 200 len: 1357 microversion: 2.1 time: 0.174898 Aug 31 13:17:59.917671 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 543/1060] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:17:59 2022] GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:18:00.452235 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-b06150e6-e12c-4793-ae18-e3f7a3f74da5 req-55dac063-8a25-430a-853f-e14fe5175a4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e6b5882-44a3-458e-9cf5-6a47e6832ffa", "name": "network-vif-plugged", "status": "completed", "tag": "e5fafc0e-5dd3-4edf-aa02-6c2a7a309f7f"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:18:00.462044 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-b06150e6-e12c-4793-ae18-e3f7a3f74da5 req-55dac063-8a25-430a-853f-e14fe5175a4a service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:18:00.462511 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-b06150e6-e12c-4793-ae18-e3f7a3f74da5 req-55dac063-8a25-430a-853f-e14fe5175a4a service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:18:00.462934 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-b06150e6-e12c-4793-ae18-e3f7a3f74da5 req-55dac063-8a25-430a-853f-e14fe5175a4a service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:18:00.474593 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-b06150e6-e12c-4793-ae18-e3f7a3f74da5 req-55dac063-8a25-430a-853f-e14fe5175a4a service nova] Creating event network-vif-plugged:e5fafc0e-5dd3-4edf-aa02-6c2a7a309f7f for instance 5e6b5882-44a3-458e-9cf5-6a47e6832ffa on hv-cinder-85442 Aug 31 13:18:00.479740 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-b06150e6-e12c-4793-ae18-e3f7a3f74da5 req-55dac063-8a25-430a-853f-e14fe5175a4a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183613 Aug 31 13:18:00.480386 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 518/1061] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:18:00.940407 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-178061dc-a987-4b4e-85c4-b6bdad8027df tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:18:00.941476 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-178061dc-a987-4b4e-85c4-b6bdad8027df tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:18:00.948840 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-178061dc-a987-4b4e-85c4-b6bdad8027df tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:18:00.949320 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-178061dc-a987-4b4e-85c4-b6bdad8027df tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:18:00.949788 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-178061dc-a987-4b4e-85c4-b6bdad8027df tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:18:00.950486 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-178061dc-a987-4b4e-85c4-b6bdad8027df tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:18:00.950943 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-178061dc-a987-4b4e-85c4-b6bdad8027df tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:18:00.951395 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-178061dc-a987-4b4e-85c4-b6bdad8027df tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:18:01.097469 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-178061dc-a987-4b4e-85c4-b6bdad8027df tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e284876d9f483a855b382e6ac7ee82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed119c3fb6874ad3bc5caaa6a78288a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:18:01.105718 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-178061dc-a987-4b4e-85c4-b6bdad8027df tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa" status: 200 len: 1357 microversion: 2.1 time: 0.171295 Aug 31 13:18:01.106304 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 544/1062] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:18:00 2022] GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:18:02.139785 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-33afd980-3e99-47d9-bcc0-10133de34361 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:18:02.140965 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-33afd980-3e99-47d9-bcc0-10133de34361 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:18:02.149721 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-33afd980-3e99-47d9-bcc0-10133de34361 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:18:02.150198 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-33afd980-3e99-47d9-bcc0-10133de34361 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:18:02.150631 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-33afd980-3e99-47d9-bcc0-10133de34361 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:18:02.151331 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-33afd980-3e99-47d9-bcc0-10133de34361 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:18:02.151779 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-33afd980-3e99-47d9-bcc0-10133de34361 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:18:02.152238 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-33afd980-3e99-47d9-bcc0-10133de34361 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:18:02.288554 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-33afd980-3e99-47d9-bcc0-10133de34361 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e284876d9f483a855b382e6ac7ee82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed119c3fb6874ad3bc5caaa6a78288a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:18:02.296834 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-33afd980-3e99-47d9-bcc0-10133de34361 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa" status: 200 len: 1357 microversion: 2.1 time: 0.164270 Aug 31 13:18:02.297409 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 519/1063] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:18:02 2022] GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:18:03.322173 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-8f12d234-9b1d-45b1-8f0c-1f66ae76c7a2 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:18:03.323093 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-8f12d234-9b1d-45b1-8f0c-1f66ae76c7a2 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:18:03.334750 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8f12d234-9b1d-45b1-8f0c-1f66ae76c7a2 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:18:03.335657 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8f12d234-9b1d-45b1-8f0c-1f66ae76c7a2 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:18:03.336618 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8f12d234-9b1d-45b1-8f0c-1f66ae76c7a2 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:18:03.337753 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8f12d234-9b1d-45b1-8f0c-1f66ae76c7a2 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:18:03.338487 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8f12d234-9b1d-45b1-8f0c-1f66ae76c7a2 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:18:03.339177 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8f12d234-9b1d-45b1-8f0c-1f66ae76c7a2 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:18:03.475183 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-8f12d234-9b1d-45b1-8f0c-1f66ae76c7a2 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e284876d9f483a855b382e6ac7ee82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed119c3fb6874ad3bc5caaa6a78288a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:18:03.483038 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-8f12d234-9b1d-45b1-8f0c-1f66ae76c7a2 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa" status: 200 len: 1546 microversion: 2.1 time: 0.167752 Aug 31 13:18:03.483618 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 545/1064] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:18:03 2022] GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa => generated 1546 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:18:03.506033 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-df5afc41-14ae-4427-8fb9-3a84155594be tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:18:03.506669 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-df5afc41-14ae-4427-8fb9-3a84155594be tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:18:03.513253 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-df5afc41-14ae-4427-8fb9-3a84155594be tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:18:03.513739 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-df5afc41-14ae-4427-8fb9-3a84155594be tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:18:03.514171 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-df5afc41-14ae-4427-8fb9-3a84155594be tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:18:03.514855 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-df5afc41-14ae-4427-8fb9-3a84155594be tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:18:03.515307 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-df5afc41-14ae-4427-8fb9-3a84155594be tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:18:03.515725 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-df5afc41-14ae-4427-8fb9-3a84155594be tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:18:03.658625 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-df5afc41-14ae-4427-8fb9-3a84155594be tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e284876d9f483a855b382e6ac7ee82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed119c3fb6874ad3bc5caaa6a78288a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:18:03.666725 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-df5afc41-14ae-4427-8fb9-3a84155594be tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa" status: 200 len: 1546 microversion: 2.1 time: 0.167060 Aug 31 13:18:03.667310 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 520/1065] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:18:03 2022] GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa => generated 1546 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:18:03.686442 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-348344f1-763c-428a-813a-f352b1f713e5 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:18:03.691244 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-348344f1-763c-428a-813a-f352b1f713e5 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '91e284876d9f483a855b382e6ac7ee82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed119c3fb6874ad3bc5caaa6a78288a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:18:03.692128 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-348344f1-763c-428a-813a-f352b1f713e5 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Searching by: {'deleted': False, 'project_id': 'ed119c3fb6874ad3bc5caaa6a78288a5'} {{(pid=120704) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 13:18:03.699487 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-348344f1-763c-428a-813a-f352b1f713e5 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:18:03.700022 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-348344f1-763c-428a-813a-f352b1f713e5 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:18:03.700548 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-348344f1-763c-428a-813a-f352b1f713e5 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:18:03.701286 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-348344f1-763c-428a-813a-f352b1f713e5 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:18:03.701825 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-348344f1-763c-428a-813a-f352b1f713e5 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:18:03.702247 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-348344f1-763c-428a-813a-f352b1f713e5 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:18:03.794189 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.multi_cell_list [None req-348344f1-763c-428a-813a-f352b1f713e5 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120704) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 13:18:03.892117 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-348344f1-763c-428a-813a-f352b1f713e5 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.209328 Aug 31 13:18:03.892612 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 546/1066] 10.222.0.58 () {58 vars in 1125 bytes} [Wed Aug 31 13:18:03 2022] GET /compute/v2.1/servers => generated 342 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:18:03.904522 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3a70c2b0-55b6-4425-a567-1c359725b83d tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:18:03.905121 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-3a70c2b0-55b6-4425-a567-1c359725b83d tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:18:03.911299 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3a70c2b0-55b6-4425-a567-1c359725b83d tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:18:03.911839 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3a70c2b0-55b6-4425-a567-1c359725b83d tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:18:03.912282 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3a70c2b0-55b6-4425-a567-1c359725b83d tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:18:03.912960 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3a70c2b0-55b6-4425-a567-1c359725b83d tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:18:03.913395 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3a70c2b0-55b6-4425-a567-1c359725b83d tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:18:03.913827 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3a70c2b0-55b6-4425-a567-1c359725b83d tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:18:04.054062 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-3a70c2b0-55b6-4425-a567-1c359725b83d tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e284876d9f483a855b382e6ac7ee82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed119c3fb6874ad3bc5caaa6a78288a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:18:04.062430 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-3a70c2b0-55b6-4425-a567-1c359725b83d tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa" status: 200 len: 1546 microversion: 2.1 time: 0.162187 Aug 31 13:18:04.063018 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 521/1067] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:18:03 2022] GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa => generated 1546 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:18:05.629675 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-5435f480-fe6d-4e48-9a72-90d1f05052f6 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d8d04599-7862-44a4-9aae-b07ff92f1058"}} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:18:05.632068 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-5435f480-fe6d-4e48-9a72-90d1f05052f6 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:18:05.638670 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5435f480-fe6d-4e48-9a72-90d1f05052f6 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:18:05.639153 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5435f480-fe6d-4e48-9a72-90d1f05052f6 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:18:05.639575 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5435f480-fe6d-4e48-9a72-90d1f05052f6 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:18:05.640285 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5435f480-fe6d-4e48-9a72-90d1f05052f6 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:18:05.640718 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5435f480-fe6d-4e48-9a72-90d1f05052f6 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:18:05.641126 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-5435f480-fe6d-4e48-9a72-90d1f05052f6 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:18:05.938763 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-5435f480-fe6d-4e48-9a72-90d1f05052f6 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "POST /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.312919 Aug 31 13:18:05.940094 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 547/1068] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 31 13:18:05 2022] POST /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa/os-volume_attachments => generated 194 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:18:13.633278 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-9e8e1d53-82e9-437e-bc1d-7fd44c16ab6a tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:18:13.633827 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-9e8e1d53-82e9-437e-bc1d-7fd44c16ab6a tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:18:13.636186 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:18:13.641723 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9e8e1d53-82e9-437e-bc1d-7fd44c16ab6a tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:18:13.642192 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9e8e1d53-82e9-437e-bc1d-7fd44c16ab6a tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:18:13.642619 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9e8e1d53-82e9-437e-bc1d-7fd44c16ab6a tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:18:13.643305 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9e8e1d53-82e9-437e-bc1d-7fd44c16ab6a tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:18:13.643740 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9e8e1d53-82e9-437e-bc1d-7fd44c16ab6a tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:18:13.644161 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9e8e1d53-82e9-437e-bc1d-7fd44c16ab6a tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:18:13.647205 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=77 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:18:13.783266 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-9e8e1d53-82e9-437e-bc1d-7fd44c16ab6a tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e284876d9f483a855b382e6ac7ee82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed119c3fb6874ad3bc5caaa6a78288a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:18:13.796423 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-9e8e1d53-82e9-437e-bc1d-7fd44c16ab6a tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa" status: 200 len: 1592 microversion: 2.1 time: 0.167026 Aug 31 13:18:13.797009 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 522/1069] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:18:13 2022] GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa => generated 1592 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:18:15.503945 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell0:SELECT=2 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:18:15.570590 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-946556cd-6d9a-4139-8d2e-fd518b72ae6e req-7643691f-163a-4968-a698-73dc1054775a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e6b5882-44a3-458e-9cf5-6a47e6832ffa", "tag": "e5fafc0e-5dd3-4edf-aa02-6c2a7a309f7f"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:18:15.576039 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:18:15.582821 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-946556cd-6d9a-4139-8d2e-fd518b72ae6e req-7643691f-163a-4968-a698-73dc1054775a service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:18:15.583227 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-946556cd-6d9a-4139-8d2e-fd518b72ae6e req-7643691f-163a-4968-a698-73dc1054775a service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:18:15.583649 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-946556cd-6d9a-4139-8d2e-fd518b72ae6e req-7643691f-163a-4968-a698-73dc1054775a service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:18:15.595244 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:18:15.597764 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-946556cd-6d9a-4139-8d2e-fd518b72ae6e req-7643691f-163a-4968-a698-73dc1054775a service nova] Creating event network-changed:e5fafc0e-5dd3-4edf-aa02-6c2a7a309f7f for instance 5e6b5882-44a3-458e-9cf5-6a47e6832ffa on hv-cinder-85442 Aug 31 13:18:15.603637 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-946556cd-6d9a-4139-8d2e-fd518b72ae6e req-7643691f-163a-4968-a698-73dc1054775a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105006 Aug 31 13:18:15.604369 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 548/1070] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:18:16.548353 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b9e41d61-0f25-4ec8-8316-7dd66bcbc1ad tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-917675613"}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:18:16.548987 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b9e41d61-0f25-4ec8-8316-7dd66bcbc1ad tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:18:16.555654 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b9e41d61-0f25-4ec8-8316-7dd66bcbc1ad tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:18:16.556176 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b9e41d61-0f25-4ec8-8316-7dd66bcbc1ad tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:18:16.556607 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b9e41d61-0f25-4ec8-8316-7dd66bcbc1ad tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:18:16.557303 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b9e41d61-0f25-4ec8-8316-7dd66bcbc1ad tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:18:16.557748 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b9e41d61-0f25-4ec8-8316-7dd66bcbc1ad tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:18:16.558168 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b9e41d61-0f25-4ec8-8316-7dd66bcbc1ad tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:18:16.693795 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.network.security_group_api [None req-b9e41d61-0f25-4ec8-8316-7dd66bcbc1ad tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Adding security group 47b96869-803d-4d21-ba9f-776894b71f86 to port e5fafc0e-5dd3-4edf-aa02-6c2a7a309f7f Aug 31 13:18:17.029722 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b9e41d61-0f25-4ec8-8316-7dd66bcbc1ad tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "POST /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa/action" status: 202 len: 0 microversion: 2.1 time: 0.485399 Aug 31 13:18:17.030472 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 523/1071] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 31 13:18:16 2022] POST /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa/action => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:18:17.040823 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-6b354c3d-adfc-4d1f-a90b-1a67e1bcd487 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:18:17.041516 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-6b354c3d-adfc-4d1f-a90b-1a67e1bcd487 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:18:17.048893 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6b354c3d-adfc-4d1f-a90b-1a67e1bcd487 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:18:17.049380 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6b354c3d-adfc-4d1f-a90b-1a67e1bcd487 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:18:17.049820 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6b354c3d-adfc-4d1f-a90b-1a67e1bcd487 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:18:17.051137 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6b354c3d-adfc-4d1f-a90b-1a67e1bcd487 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:18:17.051137 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6b354c3d-adfc-4d1f-a90b-1a67e1bcd487 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:18:17.051394 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6b354c3d-adfc-4d1f-a90b-1a67e1bcd487 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:18:17.198865 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-6b354c3d-adfc-4d1f-a90b-1a67e1bcd487 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e284876d9f483a855b382e6ac7ee82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed119c3fb6874ad3bc5caaa6a78288a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:18:17.207563 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-6b354c3d-adfc-4d1f-a90b-1a67e1bcd487 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa" status: 200 len: 1756 microversion: 2.1 time: 0.172362 Aug 31 13:18:17.208450 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 549/1072] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:18:17 2022] GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:18:17.619557 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-27a5fb8d-8bd9-4f21-adef-85275b21e9ca req-80708d1c-5145-4b08-8752-f0d5eef633dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e6b5882-44a3-458e-9cf5-6a47e6832ffa", "tag": "e5fafc0e-5dd3-4edf-aa02-6c2a7a309f7f"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:18:17.629740 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-27a5fb8d-8bd9-4f21-adef-85275b21e9ca req-80708d1c-5145-4b08-8752-f0d5eef633dd service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:18:17.630210 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-27a5fb8d-8bd9-4f21-adef-85275b21e9ca req-80708d1c-5145-4b08-8752-f0d5eef633dd service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:18:17.630636 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-27a5fb8d-8bd9-4f21-adef-85275b21e9ca req-80708d1c-5145-4b08-8752-f0d5eef633dd service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:18:17.642534 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-27a5fb8d-8bd9-4f21-adef-85275b21e9ca req-80708d1c-5145-4b08-8752-f0d5eef633dd service nova] Creating event network-changed:e5fafc0e-5dd3-4edf-aa02-6c2a7a309f7f for instance 5e6b5882-44a3-458e-9cf5-6a47e6832ffa on hv-cinder-85442 Aug 31 13:18:17.647675 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-27a5fb8d-8bd9-4f21-adef-85275b21e9ca req-80708d1c-5145-4b08-8752-f0d5eef633dd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032339 Aug 31 13:18:17.648317 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 524/1073] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:19:31.332642 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_api:SELECT=3 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:19:31.333850 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell1:SELECT=7 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:19:31.335700 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 13:19:31.336058 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Wed Aug 31 13:19:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa/action (ip 10.222.0.58) !!! Aug 31 13:19:31.344786 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-1f5f09b4-bcd6-4168-9877-ed46b3e8e7b5 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:19:31.347061 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-1f5f09b4-bcd6-4168-9877-ed46b3e8e7b5 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:19:31.355178 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1f5f09b4-bcd6-4168-9877-ed46b3e8e7b5 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:19:31.355645 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1f5f09b4-bcd6-4168-9877-ed46b3e8e7b5 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:19:31.356100 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1f5f09b4-bcd6-4168-9877-ed46b3e8e7b5 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:19:31.356773 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1f5f09b4-bcd6-4168-9877-ed46b3e8e7b5 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:19:31.357212 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1f5f09b4-bcd6-4168-9877-ed46b3e8e7b5 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:19:31.357611 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-1f5f09b4-bcd6-4168-9877-ed46b3e8e7b5 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:19:31.435648 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-1f5f09b4-bcd6-4168-9877-ed46b3e8e7b5 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "POST /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa/action" status: 202 len: 0 microversion: 2.1 time: 0.105858 Aug 31 13:19:31.436318 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 550/1074] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 31 13:19:31 2022] POST /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:19:31.443006 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=5 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:19:31.443760 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=11 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:19:31.445109 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 13:19:31.445360 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Wed Aug 31 13:19:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa (ip 10.222.0.58) !!! Aug 31 13:19:31.452042 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-38bca7e2-0bb9-4c49-9634-ff463a36dc68 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:19:31.452739 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-38bca7e2-0bb9-4c49-9634-ff463a36dc68 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:19:31.462878 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-38bca7e2-0bb9-4c49-9634-ff463a36dc68 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:19:31.463066 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-38bca7e2-0bb9-4c49-9634-ff463a36dc68 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:19:31.463494 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-38bca7e2-0bb9-4c49-9634-ff463a36dc68 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:19:31.464227 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-38bca7e2-0bb9-4c49-9634-ff463a36dc68 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:19:31.464681 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-38bca7e2-0bb9-4c49-9634-ff463a36dc68 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:19:31.465102 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-38bca7e2-0bb9-4c49-9634-ff463a36dc68 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:19:31.674660 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-38bca7e2-0bb9-4c49-9634-ff463a36dc68 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e284876d9f483a855b382e6ac7ee82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed119c3fb6874ad3bc5caaa6a78288a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:19:31.683570 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-38bca7e2-0bb9-4c49-9634-ff463a36dc68 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa" status: 200 len: 1748 microversion: 2.1 time: 0.242595 Aug 31 13:19:31.684235 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 525/1075] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:19:31 2022] GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa => generated 1748 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:19:32.710934 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-429d1d50-ce60-43f5-8eca-2e886cda65d0 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:19:32.712426 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-429d1d50-ce60-43f5-8eca-2e886cda65d0 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:19:32.722598 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-429d1d50-ce60-43f5-8eca-2e886cda65d0 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:19:32.723226 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-429d1d50-ce60-43f5-8eca-2e886cda65d0 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:19:32.723846 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-429d1d50-ce60-43f5-8eca-2e886cda65d0 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:19:32.724778 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-429d1d50-ce60-43f5-8eca-2e886cda65d0 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:19:32.725381 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-429d1d50-ce60-43f5-8eca-2e886cda65d0 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:19:32.725963 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-429d1d50-ce60-43f5-8eca-2e886cda65d0 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:19:32.953058 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-429d1d50-ce60-43f5-8eca-2e886cda65d0 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e284876d9f483a855b382e6ac7ee82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed119c3fb6874ad3bc5caaa6a78288a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:19:32.962790 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-429d1d50-ce60-43f5-8eca-2e886cda65d0 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa" status: 200 len: 1753 microversion: 2.1 time: 0.260018 Aug 31 13:19:32.963370 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 551/1076] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:19:32 2022] GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa => generated 1753 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:19:33.984741 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-01f817d1-cab1-41d2-adcf-7d57eaf66c7e tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:19:33.985453 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-01f817d1-cab1-41d2-adcf-7d57eaf66c7e tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:19:33.992040 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-01f817d1-cab1-41d2-adcf-7d57eaf66c7e tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:19:33.992523 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-01f817d1-cab1-41d2-adcf-7d57eaf66c7e tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:19:33.992951 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-01f817d1-cab1-41d2-adcf-7d57eaf66c7e tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:19:33.993628 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-01f817d1-cab1-41d2-adcf-7d57eaf66c7e tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:19:33.994071 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-01f817d1-cab1-41d2-adcf-7d57eaf66c7e tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:19:33.994482 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-01f817d1-cab1-41d2-adcf-7d57eaf66c7e tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:19:34.140978 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-01f817d1-cab1-41d2-adcf-7d57eaf66c7e tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e284876d9f483a855b382e6ac7ee82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed119c3fb6874ad3bc5caaa6a78288a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:19:34.155123 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-01f817d1-cab1-41d2-adcf-7d57eaf66c7e tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa" status: 200 len: 1753 microversion: 2.1 time: 0.174031 Aug 31 13:19:34.156148 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 526/1077] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:19:33 2022] GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa => generated 1753 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:19:35.181618 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-08198be2-d06a-4260-b684-ac54364b4b52 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:19:35.182510 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-08198be2-d06a-4260-b684-ac54364b4b52 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:19:35.194049 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-08198be2-d06a-4260-b684-ac54364b4b52 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:19:35.194732 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-08198be2-d06a-4260-b684-ac54364b4b52 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:19:35.195427 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-08198be2-d06a-4260-b684-ac54364b4b52 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:19:35.196585 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-08198be2-d06a-4260-b684-ac54364b4b52 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:19:35.197308 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-08198be2-d06a-4260-b684-ac54364b4b52 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:19:35.197982 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-08198be2-d06a-4260-b684-ac54364b4b52 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:19:35.352866 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-08198be2-d06a-4260-b684-ac54364b4b52 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e284876d9f483a855b382e6ac7ee82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed119c3fb6874ad3bc5caaa6a78288a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:19:35.361943 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-08198be2-d06a-4260-b684-ac54364b4b52 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa" status: 200 len: 1753 microversion: 2.1 time: 0.187276 Aug 31 13:19:35.362522 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 552/1078] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:19:35 2022] GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa => generated 1753 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:19:36.387316 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3a527415-d53a-43d7-bdd4-33ad1054c758 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:19:36.388246 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-3a527415-d53a-43d7-bdd4-33ad1054c758 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:19:36.399418 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3a527415-d53a-43d7-bdd4-33ad1054c758 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:19:36.400262 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3a527415-d53a-43d7-bdd4-33ad1054c758 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:19:36.400970 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3a527415-d53a-43d7-bdd4-33ad1054c758 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:19:36.402086 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3a527415-d53a-43d7-bdd4-33ad1054c758 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:19:36.402816 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3a527415-d53a-43d7-bdd4-33ad1054c758 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:19:36.403867 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3a527415-d53a-43d7-bdd4-33ad1054c758 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:19:36.551435 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-3a527415-d53a-43d7-bdd4-33ad1054c758 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e284876d9f483a855b382e6ac7ee82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed119c3fb6874ad3bc5caaa6a78288a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:19:36.564109 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-3a527415-d53a-43d7-bdd4-33ad1054c758 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa" status: 200 len: 1753 microversion: 2.1 time: 0.183416 Aug 31 13:19:36.564692 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 527/1079] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:19:36 2022] GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa => generated 1753 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:19:37.588894 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-9a0c3283-08f8-443f-b472-1eed0718eee3 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:19:37.589936 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-9a0c3283-08f8-443f-b472-1eed0718eee3 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:19:37.600321 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9a0c3283-08f8-443f-b472-1eed0718eee3 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:19:37.600801 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9a0c3283-08f8-443f-b472-1eed0718eee3 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:19:37.601290 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9a0c3283-08f8-443f-b472-1eed0718eee3 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:19:37.602221 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9a0c3283-08f8-443f-b472-1eed0718eee3 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:19:37.602795 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9a0c3283-08f8-443f-b472-1eed0718eee3 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:19:37.603364 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9a0c3283-08f8-443f-b472-1eed0718eee3 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:19:37.772318 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-9a0c3283-08f8-443f-b472-1eed0718eee3 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e284876d9f483a855b382e6ac7ee82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed119c3fb6874ad3bc5caaa6a78288a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:19:37.784659 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-9a0c3283-08f8-443f-b472-1eed0718eee3 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa" status: 200 len: 1753 microversion: 2.1 time: 0.202232 Aug 31 13:19:37.785236 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 553/1080] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:19:37 2022] GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa => generated 1753 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:19:38.808346 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-cac3d99a-631d-4fe9-955f-9aafda3e3028 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:19:38.809086 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-cac3d99a-631d-4fe9-955f-9aafda3e3028 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:19:38.817088 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cac3d99a-631d-4fe9-955f-9aafda3e3028 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:19:38.817574 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cac3d99a-631d-4fe9-955f-9aafda3e3028 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:19:38.818065 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cac3d99a-631d-4fe9-955f-9aafda3e3028 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:19:38.818756 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cac3d99a-631d-4fe9-955f-9aafda3e3028 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:19:38.819212 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cac3d99a-631d-4fe9-955f-9aafda3e3028 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:19:38.819638 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cac3d99a-631d-4fe9-955f-9aafda3e3028 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:19:38.969288 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-cac3d99a-631d-4fe9-955f-9aafda3e3028 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e284876d9f483a855b382e6ac7ee82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed119c3fb6874ad3bc5caaa6a78288a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:19:38.977985 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-cac3d99a-631d-4fe9-955f-9aafda3e3028 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa" status: 200 len: 1753 microversion: 2.1 time: 0.174760 Aug 31 13:19:38.978623 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 528/1081] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:19:38 2022] GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa => generated 1753 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:19:39.998997 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-ec21b024-04a9-4f02-8d25-d47c1c500418 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:19:39.999620 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-ec21b024-04a9-4f02-8d25-d47c1c500418 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:19:40.006367 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ec21b024-04a9-4f02-8d25-d47c1c500418 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:19:40.006845 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ec21b024-04a9-4f02-8d25-d47c1c500418 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:19:40.007274 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ec21b024-04a9-4f02-8d25-d47c1c500418 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:19:40.007999 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ec21b024-04a9-4f02-8d25-d47c1c500418 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:19:40.008445 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ec21b024-04a9-4f02-8d25-d47c1c500418 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:19:40.008863 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ec21b024-04a9-4f02-8d25-d47c1c500418 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:19:40.152636 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-ec21b024-04a9-4f02-8d25-d47c1c500418 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e284876d9f483a855b382e6ac7ee82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed119c3fb6874ad3bc5caaa6a78288a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:19:40.163717 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-ec21b024-04a9-4f02-8d25-d47c1c500418 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa" status: 200 len: 1753 microversion: 2.1 time: 0.168703 Aug 31 13:19:40.164353 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 554/1082] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:19:39 2022] GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:19:41.184674 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e35f4bcd-4774-4ba6-b0cb-5410fd8cfb65 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:19:41.185286 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e35f4bcd-4774-4ba6-b0cb-5410fd8cfb65 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:19:41.193348 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e35f4bcd-4774-4ba6-b0cb-5410fd8cfb65 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:19:41.194010 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e35f4bcd-4774-4ba6-b0cb-5410fd8cfb65 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:19:41.194569 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e35f4bcd-4774-4ba6-b0cb-5410fd8cfb65 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:19:41.195557 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e35f4bcd-4774-4ba6-b0cb-5410fd8cfb65 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:19:41.196024 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e35f4bcd-4774-4ba6-b0cb-5410fd8cfb65 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:19:41.196602 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e35f4bcd-4774-4ba6-b0cb-5410fd8cfb65 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:19:41.349601 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e35f4bcd-4774-4ba6-b0cb-5410fd8cfb65 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e284876d9f483a855b382e6ac7ee82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed119c3fb6874ad3bc5caaa6a78288a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:19:41.363113 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e35f4bcd-4774-4ba6-b0cb-5410fd8cfb65 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa" status: 200 len: 1753 microversion: 2.1 time: 0.182207 Aug 31 13:19:41.364145 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 529/1083] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:19:41 2022] GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa => generated 1753 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:19:42.389989 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-3c6a9a4b-44d9-4f77-bec9-a8f8e94c0ca8 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:19:42.390642 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-3c6a9a4b-44d9-4f77-bec9-a8f8e94c0ca8 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:19:42.401060 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3c6a9a4b-44d9-4f77-bec9-a8f8e94c0ca8 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:19:42.401663 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3c6a9a4b-44d9-4f77-bec9-a8f8e94c0ca8 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:19:42.402311 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3c6a9a4b-44d9-4f77-bec9-a8f8e94c0ca8 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:19:42.403598 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3c6a9a4b-44d9-4f77-bec9-a8f8e94c0ca8 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:19:42.404254 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3c6a9a4b-44d9-4f77-bec9-a8f8e94c0ca8 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:19:42.404725 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3c6a9a4b-44d9-4f77-bec9-a8f8e94c0ca8 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:19:42.557610 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-3c6a9a4b-44d9-4f77-bec9-a8f8e94c0ca8 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e284876d9f483a855b382e6ac7ee82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed119c3fb6874ad3bc5caaa6a78288a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:19:42.571058 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-3c6a9a4b-44d9-4f77-bec9-a8f8e94c0ca8 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa" status: 200 len: 1753 microversion: 2.1 time: 0.187399 Aug 31 13:19:42.571842 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 555/1084] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:19:42 2022] GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa => generated 1753 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:19:43.597703 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-c985cb64-5ff6-4f2e-b21c-cc332a6dcc49 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:19:43.598282 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-c985cb64-5ff6-4f2e-b21c-cc332a6dcc49 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:19:43.605317 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c985cb64-5ff6-4f2e-b21c-cc332a6dcc49 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:19:43.605800 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c985cb64-5ff6-4f2e-b21c-cc332a6dcc49 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:19:43.606231 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c985cb64-5ff6-4f2e-b21c-cc332a6dcc49 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:19:43.606924 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c985cb64-5ff6-4f2e-b21c-cc332a6dcc49 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:19:43.607379 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c985cb64-5ff6-4f2e-b21c-cc332a6dcc49 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:19:43.607841 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-c985cb64-5ff6-4f2e-b21c-cc332a6dcc49 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:19:44.025091 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-c985cb64-5ff6-4f2e-b21c-cc332a6dcc49 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e284876d9f483a855b382e6ac7ee82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed119c3fb6874ad3bc5caaa6a78288a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:19:44.034336 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-c985cb64-5ff6-4f2e-b21c-cc332a6dcc49 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa" status: 200 len: 1753 microversion: 2.1 time: 0.440590 Aug 31 13:19:44.034976 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 530/1085] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:19:43 2022] GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa => generated 1753 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:19:45.059883 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-0f846d04-da87-4ff5-ac7c-442a6268c765 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:19:45.060931 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-0f846d04-da87-4ff5-ac7c-442a6268c765 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:19:45.071547 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0f846d04-da87-4ff5-ac7c-442a6268c765 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:19:45.072398 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0f846d04-da87-4ff5-ac7c-442a6268c765 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:19:45.072831 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0f846d04-da87-4ff5-ac7c-442a6268c765 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:19:45.073523 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0f846d04-da87-4ff5-ac7c-442a6268c765 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:19:45.073969 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0f846d04-da87-4ff5-ac7c-442a6268c765 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:19:45.074389 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0f846d04-da87-4ff5-ac7c-442a6268c765 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:19:45.229413 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-0f846d04-da87-4ff5-ac7c-442a6268c765 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e284876d9f483a855b382e6ac7ee82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed119c3fb6874ad3bc5caaa6a78288a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:19:45.241904 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-0f846d04-da87-4ff5-ac7c-442a6268c765 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa" status: 200 len: 1756 microversion: 2.1 time: 0.188217 Aug 31 13:19:45.242662 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 556/1086] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:19:45 2022] GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:20:52.678805 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=12 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:20:52.680045 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=36 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:20:52.687601 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-75a50918-de19-490d-9fb1-2a0d0c28f7b5 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-917675613"}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:20:52.688519 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-75a50918-de19-490d-9fb1-2a0d0c28f7b5 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:20:52.699674 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-75a50918-de19-490d-9fb1-2a0d0c28f7b5 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:20:52.700545 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-75a50918-de19-490d-9fb1-2a0d0c28f7b5 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:20:52.701246 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-75a50918-de19-490d-9fb1-2a0d0c28f7b5 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:20:52.702487 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-75a50918-de19-490d-9fb1-2a0d0c28f7b5 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:20:52.703139 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-75a50918-de19-490d-9fb1-2a0d0c28f7b5 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:20:52.703885 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-75a50918-de19-490d-9fb1-2a0d0c28f7b5 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:20:52.838931 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.network.security_group_api [None req-75a50918-de19-490d-9fb1-2a0d0c28f7b5 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Removing security group 47b96869-803d-4d21-ba9f-776894b71f86 from port e5fafc0e-5dd3-4edf-aa02-6c2a7a309f7f Aug 31 13:20:53.163081 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-75a50918-de19-490d-9fb1-2a0d0c28f7b5 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "POST /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa/action" status: 202 len: 0 microversion: 2.1 time: 0.487146 Aug 31 13:20:53.163700 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 531/1087] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 31 13:20:52 2022] POST /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa/action => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:20:53.171856 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_api:SELECT=14 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:20:53.180661 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:20:53.185465 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-faf3842b-8b1b-40a0-925f-6b9c26db6d27 req-307adb19-7b72-4832-b0d2-3a43700fa890 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e6b5882-44a3-458e-9cf5-6a47e6832ffa", "tag": "e5fafc0e-5dd3-4edf-aa02-6c2a7a309f7f"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:20:53.196494 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-faf3842b-8b1b-40a0-925f-6b9c26db6d27 req-307adb19-7b72-4832-b0d2-3a43700fa890 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:20:53.196924 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-faf3842b-8b1b-40a0-925f-6b9c26db6d27 req-307adb19-7b72-4832-b0d2-3a43700fa890 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:20:53.197348 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-faf3842b-8b1b-40a0-925f-6b9c26db6d27 req-307adb19-7b72-4832-b0d2-3a43700fa890 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:20:53.209423 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-faf3842b-8b1b-40a0-925f-6b9c26db6d27 req-307adb19-7b72-4832-b0d2-3a43700fa890 service nova] Creating event network-changed:e5fafc0e-5dd3-4edf-aa02-6c2a7a309f7f for instance 5e6b5882-44a3-458e-9cf5-6a47e6832ffa on hv-cinder-85442 Aug 31 13:20:53.214810 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-faf3842b-8b1b-40a0-925f-6b9c26db6d27 req-307adb19-7b72-4832-b0d2-3a43700fa890 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044589 Aug 31 13:20:53.215712 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 557/1088] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:20:54.311569 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-4c3c7039-bc11-4f2f-a70f-45912028f067 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:20:54.312188 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-4c3c7039-bc11-4f2f-a70f-45912028f067 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:20:54.318469 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4c3c7039-bc11-4f2f-a70f-45912028f067 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:20:54.319057 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4c3c7039-bc11-4f2f-a70f-45912028f067 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:20:54.319583 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4c3c7039-bc11-4f2f-a70f-45912028f067 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:20:54.320363 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4c3c7039-bc11-4f2f-a70f-45912028f067 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:20:54.320877 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4c3c7039-bc11-4f2f-a70f-45912028f067 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:20:54.321501 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4c3c7039-bc11-4f2f-a70f-45912028f067 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:20:54.406478 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.objects.instance [None req-4c3c7039-bc11-4f2f-a70f-45912028f067 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lazy-loading 'services' on Instance uuid 5e6b5882-44a3-458e-9cf5-6a47e6832ffa {{(pid=120705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 13:20:54.483461 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4c3c7039-bc11-4f2f-a70f-45912028f067 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [68599916-e56e-4e23-8d01-06b63a0251c4] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 13:20:55.235434 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-e2bd6674-4fee-4e76-a891-f18bc2e979ce req-99930662-f2e9-4033-83e2-81b109d8f9d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e6b5882-44a3-458e-9cf5-6a47e6832ffa", "tag": "e5fafc0e-5dd3-4edf-aa02-6c2a7a309f7f"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:20:55.246237 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-e2bd6674-4fee-4e76-a891-f18bc2e979ce req-99930662-f2e9-4033-83e2-81b109d8f9d3 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:20:55.247204 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-e2bd6674-4fee-4e76-a891-f18bc2e979ce req-99930662-f2e9-4033-83e2-81b109d8f9d3 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:20:55.247579 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-e2bd6674-4fee-4e76-a891-f18bc2e979ce req-99930662-f2e9-4033-83e2-81b109d8f9d3 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:20:55.260755 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-e2bd6674-4fee-4e76-a891-f18bc2e979ce req-99930662-f2e9-4033-83e2-81b109d8f9d3 service nova] Creating event network-changed:e5fafc0e-5dd3-4edf-aa02-6c2a7a309f7f for instance 5e6b5882-44a3-458e-9cf5-6a47e6832ffa on hv-cinder-85442 Aug 31 13:20:55.265632 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-e2bd6674-4fee-4e76-a891-f18bc2e979ce req-99930662-f2e9-4033-83e2-81b109d8f9d3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034990 Aug 31 13:20:55.266586 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 558/1089] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:20:55.491957 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO oslo.messaging._drivers.impl_rabbit [None req-4c3c7039-bc11-4f2f-a70f-45912028f067 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [68599916-e56e-4e23-8d01-06b63a0251c4] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 46676. Aug 31 13:20:55.495526 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-4c3c7039-bc11-4f2f-a70f-45912028f067 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa/os-volume_attachments/d8d04599-7862-44a4-9aae-b07ff92f1058" status: 202 len: 0 microversion: 2.1 time: 1.188854 Aug 31 13:20:55.496161 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 532/1090] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 31 13:20:54 2022] DELETE /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa/os-volume_attachments/d8d04599-7862-44a4-9aae-b07ff92f1058 => generated 0 bytes in 1190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:20:55.505260 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-3dd00a16-41f8-4fb4-8ad0-0747df826884 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:20:55.507662 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-3dd00a16-41f8-4fb4-8ad0-0747df826884 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:20:55.514971 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3dd00a16-41f8-4fb4-8ad0-0747df826884 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:20:55.515909 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3dd00a16-41f8-4fb4-8ad0-0747df826884 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:20:55.516623 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3dd00a16-41f8-4fb4-8ad0-0747df826884 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:20:55.517323 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3dd00a16-41f8-4fb4-8ad0-0747df826884 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:20:55.517936 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3dd00a16-41f8-4fb4-8ad0-0747df826884 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:20:55.518356 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3dd00a16-41f8-4fb4-8ad0-0747df826884 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:20:55.551965 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-3dd00a16-41f8-4fb4-8ad0-0747df826884 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050905 Aug 31 13:20:55.552544 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 559/1091] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 31 13:20:55 2022] GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:20:56.570590 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-9ba74e98-d853-4918-9ec0-7e5b87d3f27b tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:20:56.574253 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-9ba74e98-d853-4918-9ec0-7e5b87d3f27b tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:20:56.581644 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9ba74e98-d853-4918-9ec0-7e5b87d3f27b tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:20:56.582127 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9ba74e98-d853-4918-9ec0-7e5b87d3f27b tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:20:56.582558 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9ba74e98-d853-4918-9ec0-7e5b87d3f27b tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:20:56.583255 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9ba74e98-d853-4918-9ec0-7e5b87d3f27b tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:20:56.583695 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9ba74e98-d853-4918-9ec0-7e5b87d3f27b tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:20:56.584143 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-9ba74e98-d853-4918-9ec0-7e5b87d3f27b tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:20:56.615001 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-9ba74e98-d853-4918-9ec0-7e5b87d3f27b tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052786 Aug 31 13:20:56.615556 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 533/1092] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 31 13:20:56 2022] GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:20:57.631206 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-0c7ac61f-11d5-4a13-a28e-ec3d18074d74 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:20:57.634641 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-0c7ac61f-11d5-4a13-a28e-ec3d18074d74 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:20:57.645656 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0c7ac61f-11d5-4a13-a28e-ec3d18074d74 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:20:57.646443 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0c7ac61f-11d5-4a13-a28e-ec3d18074d74 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:20:57.647159 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0c7ac61f-11d5-4a13-a28e-ec3d18074d74 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:20:57.648625 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0c7ac61f-11d5-4a13-a28e-ec3d18074d74 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:20:57.649379 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0c7ac61f-11d5-4a13-a28e-ec3d18074d74 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:20:57.650128 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-0c7ac61f-11d5-4a13-a28e-ec3d18074d74 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:20:57.682135 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-0c7ac61f-11d5-4a13-a28e-ec3d18074d74 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057745 Aug 31 13:20:57.682704 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 560/1093] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 31 13:20:57 2022] GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 13:20:57.693555 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-cecbcbbe-ab84-472f-ac5b-68db55817e7e tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:20:57.694099 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-cecbcbbe-ab84-472f-ac5b-68db55817e7e tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:20:57.701018 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cecbcbbe-ab84-472f-ac5b-68db55817e7e tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:20:57.701499 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cecbcbbe-ab84-472f-ac5b-68db55817e7e tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:20:57.701930 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cecbcbbe-ab84-472f-ac5b-68db55817e7e tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:20:57.702615 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cecbcbbe-ab84-472f-ac5b-68db55817e7e tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:20:57.703061 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cecbcbbe-ab84-472f-ac5b-68db55817e7e tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:20:57.703465 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-cecbcbbe-ab84-472f-ac5b-68db55817e7e tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:20:57.796300 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-cecbcbbe-ab84-472f-ac5b-68db55817e7e tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] HTTP exception thrown: Instance 5e6b5882-44a3-458e-9cf5-6a47e6832ffa is not attached to volume d8d04599-7862-44a4-9aae-b07ff92f1058 Aug 31 13:20:57.800998 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-cecbcbbe-ab84-472f-ac5b-68db55817e7e tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Request method failure captured: Aug 31 13:20:57.800998 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: request: DELETE /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa/os-volume_attachments/d8d04599-7862-44a4-9aae-b07ff92f1058 HTTP/1.1 Aug 31 13:20:57.800998 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 31 13:20:57.800998 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 31 13:20:57.800998 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Connection: close Aug 31 13:20:57.800998 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 31 13:20:57.800998 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 31 13:20:57.800998 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Host: 10.222.0.58 Aug 31 13:20:57.800998 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 31 13:20:57.800998 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 31 13:20:57.800998 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjD19kITfOydieliC7BvDkJQRZFWrDfQXX626PcEr0-HzmNCNysP39ttUohbn0ZDb0wQwPReidPcEq9Te5LHnM6BgkQQ9er-Sfx8uECzSm_Nazk5uxIrtfpfcx11k4fuoF_X-Q9MDHz_flsJjd3kCIy289Ev9yWH4WWHysqWTuvEx99eI Aug 31 13:20:57.800998 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 31 13:20:57.800998 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 31 13:20:57.800998 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 31 13:20:57.800998 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 31 13:20:57.800998 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 31 13:20:57.800998 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 31 13:20:57.800998 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Id: ed119c3fb6874ad3bc5caaa6a78288a5 Aug 31 13:20:57.800998 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-TestMinimumBasicScenario-1902057712 Aug 31 13:20:57.800998 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Role: member,reader Aug 31 13:20:57.800998 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Roles: member,reader Aug 31 13:20:57.803183 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ed119c3fb6874ad3bc5caaa6a78288a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ed119c3fb6874ad3bc5caaa6a78288a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ed119c3fb6874ad3bc5caaa6a78288a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ed119c3fb6874ad3bc5caaa6a78288a5"}]}] Aug 31 13:20:57.803183 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-TestMinimumBasicScenario-1902057712 Aug 31 13:20:57.803183 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant-Id: ed119c3fb6874ad3bc5caaa6a78288a5 Aug 31 13:20:57.803183 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1902057712 Aug 31 13:20:57.803183 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User: tempest-TestMinimumBasicScenario-1902057712-project Aug 31 13:20:57.803183 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 31 13:20:57.803183 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 31 13:20:57.803183 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Id: 91e284876d9f483a855b382e6ac7ee82 Aug 31 13:20:57.803183 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-TestMinimumBasicScenario-1902057712-project Aug 31 13:20:57.803183 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: method: > Aug 31 13:20:57.803183 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: exception: Instance 5e6b5882-44a3-458e-9cf5-6a47e6832ffa is not attached to volume d8d04599-7862-44a4-9aae-b07ff92f1058 Aug 31 13:20:57.804196 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: action_args: {'server_id': '5e6b5882-44a3-458e-9cf5-6a47e6832ffa', 'id': 'd8d04599-7862-44a4-9aae-b07ff92f1058'} Aug 31 13:20:57.804196 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:20:57.804196 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:20:57.804196 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 31 13:20:57.804196 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 31 13:20:57.804196 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 13:20:57.804196 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 13:20:57.804196 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 31 13:20:57.804196 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 31 13:20:57.804196 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d8d04599-7862-44a4-9aae-b07ff92f1058. Aug 31 13:20:57.804196 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:20:57.804196 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:20:57.804196 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:20:57.804196 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:20:57.804196 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:20:57.804196 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:20:57.804196 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:20:57.804196 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:20:57.804196 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:20:57.805793 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:20:57.805793 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 31 13:20:57.805793 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 13:20:57.805793 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e6b5882-44a3-458e-9cf5-6a47e6832ffa is not attached to volume d8d04599-7862-44a4-9aae-b07ff92f1058 Aug 31 13:20:57.805793 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:20:57.805793 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:20:57.805793 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:20:57.805793 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:20:57.805793 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:20:57.805793 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:20:57.805793 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:20:57.805793 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:20:57.805793 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e6b5882-44a3-458e-9cf5-6a47e6832ffa is not attached to volume d8d04599-7862-44a4-9aae-b07ff92f1058 Aug 31 13:20:57.805793 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:20:57.805793 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-cecbcbbe-ab84-472f-ac5b-68db55817e7e tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Returning 404 to user: Instance 5e6b5882-44a3-458e-9cf5-6a47e6832ffa is not attached to volume d8d04599-7862-44a4-9aae-b07ff92f1058 {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:20:57.807050 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-cecbcbbe-ab84-472f-ac5b-68db55817e7e tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa/os-volume_attachments/d8d04599-7862-44a4-9aae-b07ff92f1058" status: 404 len: 154 microversion: 2.1 time: 0.114733 Aug 31 13:20:57.807050 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 534/1094] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 31 13:20:57 2022] DELETE /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa/os-volume_attachments/d8d04599-7862-44a4-9aae-b07ff92f1058 => generated 154 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:20:58.965405 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-befcdfd6-ff8b-4915-82ef-eb88d332fd19 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:20:58.965913 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-befcdfd6-ff8b-4915-82ef-eb88d332fd19 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:20:58.972760 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-befcdfd6-ff8b-4915-82ef-eb88d332fd19 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:20:58.973225 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-befcdfd6-ff8b-4915-82ef-eb88d332fd19 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:20:58.973660 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-befcdfd6-ff8b-4915-82ef-eb88d332fd19 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:20:58.974347 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-befcdfd6-ff8b-4915-82ef-eb88d332fd19 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:20:58.974779 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-befcdfd6-ff8b-4915-82ef-eb88d332fd19 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:20:58.975191 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-befcdfd6-ff8b-4915-82ef-eb88d332fd19 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:20:58.999844 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-befcdfd6-ff8b-4915-82ef-eb88d332fd19 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Going to try to terminate instance {{(pid=120704) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 13:20:59.080942 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-befcdfd6-ff8b-4915-82ef-eb88d332fd19 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa" status: 204 len: 0 microversion: 2.1 time: 0.119179 Aug 31 13:20:59.081760 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 561/1095] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 31 13:20:58 2022] DELETE /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:20:59.089969 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-27eb74b4-42ad-4a62-bc26-b0babf684433 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:20:59.090578 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-27eb74b4-42ad-4a62-bc26-b0babf684433 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:20:59.097248 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-27eb74b4-42ad-4a62-bc26-b0babf684433 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:20:59.097730 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-27eb74b4-42ad-4a62-bc26-b0babf684433 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:20:59.098163 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-27eb74b4-42ad-4a62-bc26-b0babf684433 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:20:59.098890 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-27eb74b4-42ad-4a62-bc26-b0babf684433 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:20:59.099339 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-27eb74b4-42ad-4a62-bc26-b0babf684433 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:20:59.099760 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-27eb74b4-42ad-4a62-bc26-b0babf684433 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:20:59.231388 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-27eb74b4-42ad-4a62-bc26-b0babf684433 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e284876d9f483a855b382e6ac7ee82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed119c3fb6874ad3bc5caaa6a78288a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:20:59.241229 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-27eb74b4-42ad-4a62-bc26-b0babf684433 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa" status: 200 len: 1552 microversion: 2.1 time: 0.155204 Aug 31 13:20:59.241776 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 535/1096] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:20:59 2022] GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa => generated 1552 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:21:00.268592 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-57b51946-c59d-44c8-9f70-03263837fe4e tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:21:00.269282 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-57b51946-c59d-44c8-9f70-03263837fe4e tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:21:00.278028 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-57b51946-c59d-44c8-9f70-03263837fe4e tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:21:00.278618 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-57b51946-c59d-44c8-9f70-03263837fe4e tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:21:00.279158 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-57b51946-c59d-44c8-9f70-03263837fe4e tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:21:00.280091 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-57b51946-c59d-44c8-9f70-03263837fe4e tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:21:00.280644 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-57b51946-c59d-44c8-9f70-03263837fe4e tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:21:00.281162 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-57b51946-c59d-44c8-9f70-03263837fe4e tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:21:00.426488 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-57b51946-c59d-44c8-9f70-03263837fe4e tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e284876d9f483a855b382e6ac7ee82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed119c3fb6874ad3bc5caaa6a78288a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:21:00.434546 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-57b51946-c59d-44c8-9f70-03263837fe4e tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa" status: 200 len: 1552 microversion: 2.1 time: 0.173107 Aug 31 13:21:00.435145 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 562/1097] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:21:00 2022] GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa => generated 1552 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:21:01.458508 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-def97f7f-db62-4726-9023-356eca7e0628 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:21:01.459160 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-def97f7f-db62-4726-9023-356eca7e0628 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:21:01.466529 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-def97f7f-db62-4726-9023-356eca7e0628 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:21:01.466970 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-def97f7f-db62-4726-9023-356eca7e0628 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:21:01.467403 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-def97f7f-db62-4726-9023-356eca7e0628 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:21:01.468139 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-def97f7f-db62-4726-9023-356eca7e0628 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:21:01.468568 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-def97f7f-db62-4726-9023-356eca7e0628 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:21:01.468984 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-def97f7f-db62-4726-9023-356eca7e0628 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:21:01.605723 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-def97f7f-db62-4726-9023-356eca7e0628 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e284876d9f483a855b382e6ac7ee82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed119c3fb6874ad3bc5caaa6a78288a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:21:01.613984 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-def97f7f-db62-4726-9023-356eca7e0628 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa" status: 200 len: 1552 microversion: 2.1 time: 0.160640 Aug 31 13:21:01.614546 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 536/1098] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:21:01 2022] GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa => generated 1552 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:21:02.365872 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-f1f204b1-8dd4-46e2-a621-de3649242e52 req-f4f6dffb-3a55-4e0d-bd15-76f4ab8230ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e6b5882-44a3-458e-9cf5-6a47e6832ffa", "name": "network-vif-deleted", "tag": "e5fafc0e-5dd3-4edf-aa02-6c2a7a309f7f"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:21:02.375461 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-f1f204b1-8dd4-46e2-a621-de3649242e52 req-f4f6dffb-3a55-4e0d-bd15-76f4ab8230ae service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:21:02.375961 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-f1f204b1-8dd4-46e2-a621-de3649242e52 req-f4f6dffb-3a55-4e0d-bd15-76f4ab8230ae service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:21:02.376383 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-f1f204b1-8dd4-46e2-a621-de3649242e52 req-f4f6dffb-3a55-4e0d-bd15-76f4ab8230ae service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:21:02.388198 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-f1f204b1-8dd4-46e2-a621-de3649242e52 req-f4f6dffb-3a55-4e0d-bd15-76f4ab8230ae service nova] Creating event network-vif-deleted:e5fafc0e-5dd3-4edf-aa02-6c2a7a309f7f for instance 5e6b5882-44a3-458e-9cf5-6a47e6832ffa on hv-cinder-85442 Aug 31 13:21:02.394047 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-f1f204b1-8dd4-46e2-a621-de3649242e52 req-f4f6dffb-3a55-4e0d-bd15-76f4ab8230ae service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091235 Aug 31 13:21:02.394722 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 563/1099] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:21:02.634837 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-4a2d2516-ea1a-4cdd-87d3-63edc8a95c17 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:21:02.635420 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-4a2d2516-ea1a-4cdd-87d3-63edc8a95c17 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:21:02.642643 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4a2d2516-ea1a-4cdd-87d3-63edc8a95c17 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:21:02.643154 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4a2d2516-ea1a-4cdd-87d3-63edc8a95c17 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:21:02.643590 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4a2d2516-ea1a-4cdd-87d3-63edc8a95c17 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:21:02.644339 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4a2d2516-ea1a-4cdd-87d3-63edc8a95c17 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:21:02.644774 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4a2d2516-ea1a-4cdd-87d3-63edc8a95c17 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:21:02.645194 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4a2d2516-ea1a-4cdd-87d3-63edc8a95c17 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:21:02.679206 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4a2d2516-ea1a-4cdd-87d3-63edc8a95c17 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:21:02.679779 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4a2d2516-ea1a-4cdd-87d3-63edc8a95c17 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:21:02.680426 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4a2d2516-ea1a-4cdd-87d3-63edc8a95c17 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:21:02.680696 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.objects.instance [None req-4a2d2516-ea1a-4cdd-87d3-63edc8a95c17 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lazy-loading 'fault' on Instance uuid 5e6b5882-44a3-458e-9cf5-6a47e6832ffa {{(pid=120705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 13:21:02.723050 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-4a2d2516-ea1a-4cdd-87d3-63edc8a95c17 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91e284876d9f483a855b382e6ac7ee82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed119c3fb6874ad3bc5caaa6a78288a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:21:02.731025 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-4a2d2516-ea1a-4cdd-87d3-63edc8a95c17 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa" status: 200 len: 1347 microversion: 2.1 time: 0.100127 Aug 31 13:21:02.731588 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 537/1100] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:21:02 2022] GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa => generated 1347 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:21:03.758810 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-6193d79c-e8b3-468b-84bd-5c30dbc5ebe2 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:21:03.759962 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-6193d79c-e8b3-468b-84bd-5c30dbc5ebe2 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] [instance: 5e6b5882-44a3-458e-9cf5-6a47e6832ffa] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:21:03.770145 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6193d79c-e8b3-468b-84bd-5c30dbc5ebe2 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:21:03.770613 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6193d79c-e8b3-468b-84bd-5c30dbc5ebe2 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:21:03.771047 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6193d79c-e8b3-468b-84bd-5c30dbc5ebe2 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:21:03.771747 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6193d79c-e8b3-468b-84bd-5c30dbc5ebe2 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:21:03.772228 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6193d79c-e8b3-468b-84bd-5c30dbc5ebe2 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:21:03.772642 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6193d79c-e8b3-468b-84bd-5c30dbc5ebe2 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:21:03.786743 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.wsgi [None req-6193d79c-e8b3-468b-84bd-5c30dbc5ebe2 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] HTTP exception thrown: Instance 5e6b5882-44a3-458e-9cf5-6a47e6832ffa could not be found. Aug 31 13:21:03.788419 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-6193d79c-e8b3-468b-84bd-5c30dbc5ebe2 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Request method failure captured: Aug 31 13:21:03.788419 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: request: GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa HTTP/1.1 Aug 31 13:21:03.788419 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept: application/json Aug 31 13:21:03.788419 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept-Encoding: identity Aug 31 13:21:03.788419 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Connection: close Aug 31 13:21:03.788419 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Length: 0 Aug 31 13:21:03.788419 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Type: application/json Aug 31 13:21:03.788419 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Host: 10.222.0.58 Aug 31 13:21:03.788419 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Openstack-System-Scope: None Aug 31 13:21:03.788419 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: User-Agent: python-urllib3/1.26.12 Aug 31 13:21:03.788419 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Auth-Token: gAAAAABjD19kITfOydieliC7BvDkJQRZFWrDfQXX626PcEr0-HzmNCNysP39ttUohbn0ZDb0wQwPReidPcEq9Te5LHnM6BgkQQ9er-Sfx8uECzSm_Nazk5uxIrtfpfcx11k4fuoF_X-Q9MDHz_flsJjd3kCIy289Ev9yWH4WWHysqWTuvEx99eI Aug 31 13:21:03.788419 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Id: None Aug 31 13:21:03.788419 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Name: None Aug 31 13:21:03.788419 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Identity-Status: Confirmed Aug 31 13:21:03.788419 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Is-Admin-Project: True Aug 31 13:21:03.788419 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Id: default Aug 31 13:21:03.788419 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Name: Default Aug 31 13:21:03.788419 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Id: ed119c3fb6874ad3bc5caaa6a78288a5 Aug 31 13:21:03.788419 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Name: tempest-TestMinimumBasicScenario-1902057712 Aug 31 13:21:03.788419 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Role: member,reader Aug 31 13:21:03.788419 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Roles: member,reader Aug 31 13:21:03.789976 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ed119c3fb6874ad3bc5caaa6a78288a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ed119c3fb6874ad3bc5caaa6a78288a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ed119c3fb6874ad3bc5caaa6a78288a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ed119c3fb6874ad3bc5caaa6a78288a5"}]}] Aug 31 13:21:03.789976 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant: tempest-TestMinimumBasicScenario-1902057712 Aug 31 13:21:03.789976 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Id: ed119c3fb6874ad3bc5caaa6a78288a5 Aug 31 13:21:03.789976 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1902057712 Aug 31 13:21:03.789976 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User: tempest-TestMinimumBasicScenario-1902057712-project Aug 31 13:21:03.789976 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Id: default Aug 31 13:21:03.789976 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Name: Default Aug 31 13:21:03.789976 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Id: 91e284876d9f483a855b382e6ac7ee82 Aug 31 13:21:03.789976 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Name: tempest-TestMinimumBasicScenario-1902057712-project Aug 31 13:21:03.789976 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: method: > Aug 31 13:21:03.789976 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: exception: Instance 5e6b5882-44a3-458e-9cf5-6a47e6832ffa could not be found. Aug 31 13:21:03.789976 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: action_args: {'id': '5e6b5882-44a3-458e-9cf5-6a47e6832ffa'} Aug 31 13:21:03.790939 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:21:03.790939 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:21:03.790939 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 13:21:03.790939 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 13:21:03.790939 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 13:21:03.790939 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 13:21:03.790939 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 13:21:03.790939 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 13:21:03.790939 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 13:21:03.790939 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 13:21:03.790939 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e6b5882-44a3-458e-9cf5-6a47e6832ffa could not be found. Aug 31 13:21:03.790939 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:21:03.790939 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:21:03.790939 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:21:03.790939 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:21:03.790939 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:21:03.790939 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:21:03.790939 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:21:03.790939 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:21:03.790939 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:21:03.792661 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:21:03.792661 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 13:21:03.792661 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 13:21:03.792661 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 13:21:03.792661 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 13:21:03.792661 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 13:21:03.792661 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 13:21:03.792661 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e6b5882-44a3-458e-9cf5-6a47e6832ffa could not be found. Aug 31 13:21:03.792661 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:21:03.792661 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:21:03.792661 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:21:03.792661 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:21:03.792661 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:21:03.792661 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:21:03.792661 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:21:03.792661 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:21:03.792661 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e6b5882-44a3-458e-9cf5-6a47e6832ffa could not be found. Aug 31 13:21:03.792661 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:21:03.794188 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-6193d79c-e8b3-468b-84bd-5c30dbc5ebe2 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Returning 404 to user: Instance 5e6b5882-44a3-458e-9cf5-6a47e6832ffa could not be found. {{(pid=120704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:21:03.794188 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-6193d79c-e8b3-468b-84bd-5c30dbc5ebe2 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa" status: 404 len: 111 microversion: 2.1 time: 0.039417 Aug 31 13:21:03.794188 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 564/1101] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:21:03 2022] GET /compute/v2.1/servers/5e6b5882-44a3-458e-9cf5-6a47e6832ffa => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:21:03.799237 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-eedd99a9-09e5-4f0d-8126-74e62215a663 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] Calling method '.version_select at 0x7f1954c45040>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:21:03.823834 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-eedd99a9-09e5-4f0d-8126-74e62215a663 tempest-TestMinimumBasicScenario-1902057712 tempest-TestMinimumBasicScenario-1902057712-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-889018827" status: 202 len: 0 microversion: 2.1 time: 0.028799 Aug 31 13:21:03.824425 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 538/1102] 10.222.0.58 () {58 vars in 1269 bytes} [Wed Aug 31 13:21:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-889018827 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:21:21.414890 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 13:21:21.415409 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Wed Aug 31 13:21:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.58) !!! Aug 31 13:21:21.417511 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:21:21.418366 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:21:21.615872 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-fdaa3037-45eb-417a-aa55-69ca86e44f9f tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Action: 'create', calling method: .version_select at 0x7f1951525820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-79203537", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3Ic7v2uSQxxd18zHtX8XIxtYKhbpb5pyJ1xxK/vVXIBtbUv1+/eyIXamI4M0AlGZU8kVTuoEcxfQgrC7AlCJE17DxluJKdlzGMR2158cL/yhyG6oicnNeBmuYnLre+sw=="}} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:21:21.631379 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.quota [None req-fdaa3037-45eb-417a-aa55-69ca86e44f9f tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Getting quotas for project b83394c784464c69843feac5ed7050dd. Resources: {'key_pairs'} {{(pid=120704) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 13:21:21.636327 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.quota [None req-fdaa3037-45eb-417a-aa55-69ca86e44f9f tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Getting quotas for user e6897b60675a4c99a47ed51cdcbd1d39 and project b83394c784464c69843feac5ed7050dd. Resources: {'key_pairs'} {{(pid=120704) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 13:21:21.676200 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-fdaa3037-45eb-417a-aa55-69ca86e44f9f tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.269217 Aug 31 13:21:21.677069 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 565/1103] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 31 13:21:21 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:21:46.545153 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 13:21:46.545709 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Wed Aug 31 13:21:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.58) !!! Aug 31 13:21:46.546547 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=1 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:21:46.547323 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:21:46.552200 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e63c5a28-9f47-475c-a6dc-5e45d73a9ca0 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-934816796", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-79203537", "security_groups": [{"name": "tempest-secgroup-smoke-1471111224"}], "block_device_mapping_v2": [{"uuid": "ea6af283-af90-4623-9bc0-beaca91c361f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c8f7a1ff-b0b8-4c3a-b081-57ae0e3ac414"}]}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:21:46.672036 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.network.neutron [None req-e63c5a28-9f47-475c-a6dc-5e45d73a9ca0 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] validate_networks() for [('c8f7a1ff-b0b8-4c3a-b081-57ae0e3ac414', None, None, None, None, None)] {{(pid=120705) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 13:21:47.043101 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-e63c5a28-9f47-475c-a6dc-5e45d73a9ca0 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Flavor limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 13:21:47.043519 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-e63c5a28-9f47-475c-a6dc-5e45d73a9ca0 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Image limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 13:21:47.044053 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-e63c5a28-9f47-475c-a6dc-5e45d73a9ca0 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Flavor pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 13:21:47.044455 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-e63c5a28-9f47-475c-a6dc-5e45d73a9ca0 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Image pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 13:21:47.044864 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-e63c5a28-9f47-475c-a6dc-5e45d73a9ca0 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 13:21:47.056618 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e63c5a28-9f47-475c-a6dc-5e45d73a9ca0 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:21:47.057273 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e63c5a28-9f47-475c-a6dc-5e45d73a9ca0 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:21:47.057877 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e63c5a28-9f47-475c-a6dc-5e45d73a9ca0 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:21:47.058947 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e63c5a28-9f47-475c-a6dc-5e45d73a9ca0 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:21:47.059521 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e63c5a28-9f47-475c-a6dc-5e45d73a9ca0 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:21:47.060075 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e63c5a28-9f47-475c-a6dc-5e45d73a9ca0 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:21:47.080526 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-e63c5a28-9f47-475c-a6dc-5e45d73a9ca0 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Getting quotas for project b83394c784464c69843feac5ed7050dd. Resources: {'instances', 'ram', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 13:21:47.084891 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-e63c5a28-9f47-475c-a6dc-5e45d73a9ca0 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Getting quotas for user e6897b60675a4c99a47ed51cdcbd1d39 and project b83394c784464c69843feac5ed7050dd. Resources: {'instances', 'ram', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 13:21:47.144163 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e63c5a28-9f47-475c-a6dc-5e45d73a9ca0 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Going to run 1 instances... {{(pid=120705) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 13:21:47.146321 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e63c5a28-9f47-475c-a6dc-5e45d73a9ca0 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: c8a2a22b-1752-4a98-95cf-3acd9440b8c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ea6af283-af90-4623-9bc0-beaca91c361f',volume_size=None,volume_type=None)] {{(pid=120705) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 13:21:47.294176 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e63c5a28-9f47-475c-a6dc-5e45d73a9ca0 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.750716 Aug 31 13:21:47.294938 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 539/1104] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 31 13:21:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 13:21:47.305342 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell0:SELECT=4 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:21:47.306074 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:21:47.310379 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-4a38e561-95f0-4ff3-8c59-c0c5104239e6 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:21:47.311019 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-4a38e561-95f0-4ff3-8c59-c0c5104239e6 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: c8a2a22b-1752-4a98-95cf-3acd9440b8c5] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:21:47.371520 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-4a38e561-95f0-4ff3-8c59-c0c5104239e6 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:21:47.378592 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-4a38e561-95f0-4ff3-8c59-c0c5104239e6 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5" status: 200 len: 1092 microversion: 2.1 time: 0.074720 Aug 31 13:21:47.379163 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 566/1105] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:21:47 2022] GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5 => generated 1092 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:21:48.399089 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-57d1efc1-aa98-4701-a629-5f147500bdf3 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:21:48.399711 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-57d1efc1-aa98-4701-a629-5f147500bdf3 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: c8a2a22b-1752-4a98-95cf-3acd9440b8c5] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:21:48.453598 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-57d1efc1-aa98-4701-a629-5f147500bdf3 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:21:48.460628 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-57d1efc1-aa98-4701-a629-5f147500bdf3 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5" status: 200 len: 1092 microversion: 2.1 time: 0.065983 Aug 31 13:21:48.461205 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 540/1106] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:21:48 2022] GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5 => generated 1092 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:21:49.482427 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-7867c057-5aa5-4114-928b-acfb22097535 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:21:49.483138 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-7867c057-5aa5-4114-928b-acfb22097535 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: c8a2a22b-1752-4a98-95cf-3acd9440b8c5] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:21:49.541370 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-7867c057-5aa5-4114-928b-acfb22097535 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:21:49.551668 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-7867c057-5aa5-4114-928b-acfb22097535 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5" status: 200 len: 1092 microversion: 2.1 time: 0.073627 Aug 31 13:21:49.552557 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 567/1107] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:21:49 2022] GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5 => generated 1092 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:21:50.572757 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e898e1b4-adf7-4869-8c42-eab3ba07012a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:21:50.573378 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e898e1b4-adf7-4869-8c42-eab3ba07012a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: c8a2a22b-1752-4a98-95cf-3acd9440b8c5] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:21:50.636120 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e898e1b4-adf7-4869-8c42-eab3ba07012a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:21:50.648079 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e898e1b4-adf7-4869-8c42-eab3ba07012a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5" status: 200 len: 1092 microversion: 2.1 time: 0.078851 Aug 31 13:21:50.649021 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 541/1108] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:21:50 2022] GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5 => generated 1092 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:21:51.678904 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-58d60952-d1a9-4adb-bf6e-a8bc5f5c0268 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:21:51.679888 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-58d60952-d1a9-4adb-bf6e-a8bc5f5c0268 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: c8a2a22b-1752-4a98-95cf-3acd9440b8c5] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:21:51.687843 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-58d60952-d1a9-4adb-bf6e-a8bc5f5c0268 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:21:51.688444 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-58d60952-d1a9-4adb-bf6e-a8bc5f5c0268 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:21:51.688895 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-58d60952-d1a9-4adb-bf6e-a8bc5f5c0268 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:21:51.689614 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-58d60952-d1a9-4adb-bf6e-a8bc5f5c0268 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:21:51.690083 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-58d60952-d1a9-4adb-bf6e-a8bc5f5c0268 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:21:51.690523 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-58d60952-d1a9-4adb-bf6e-a8bc5f5c0268 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:21:51.758407 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-58d60952-d1a9-4adb-bf6e-a8bc5f5c0268 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:21:51.766949 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-58d60952-d1a9-4adb-bf6e-a8bc5f5c0268 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5" status: 200 len: 1142 microversion: 2.1 time: 0.094558 Aug 31 13:21:51.767521 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 568/1109] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:21:51 2022] GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5 => generated 1142 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:21:52.788236 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-a52ed543-117b-4f8f-9d56-97dd65a5a579 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:21:52.788869 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-a52ed543-117b-4f8f-9d56-97dd65a5a579 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: c8a2a22b-1752-4a98-95cf-3acd9440b8c5] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:21:52.798071 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a52ed543-117b-4f8f-9d56-97dd65a5a579 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:21:52.798558 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a52ed543-117b-4f8f-9d56-97dd65a5a579 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:21:52.798988 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a52ed543-117b-4f8f-9d56-97dd65a5a579 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:21:52.799770 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a52ed543-117b-4f8f-9d56-97dd65a5a579 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:21:52.800258 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a52ed543-117b-4f8f-9d56-97dd65a5a579 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:21:52.801168 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a52ed543-117b-4f8f-9d56-97dd65a5a579 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:21:52.866076 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-a52ed543-117b-4f8f-9d56-97dd65a5a579 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:21:52.873969 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-a52ed543-117b-4f8f-9d56-97dd65a5a579 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5" status: 200 len: 1208 microversion: 2.1 time: 0.089741 Aug 31 13:21:52.874538 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 542/1110] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:21:52 2022] GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5 => generated 1208 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:21:53.895486 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-75e19d65-eab0-45e6-8c02-818f77e27429 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:21:53.896203 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-75e19d65-eab0-45e6-8c02-818f77e27429 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: c8a2a22b-1752-4a98-95cf-3acd9440b8c5] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:21:53.903406 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-75e19d65-eab0-45e6-8c02-818f77e27429 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:21:53.903955 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-75e19d65-eab0-45e6-8c02-818f77e27429 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:21:53.904339 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-75e19d65-eab0-45e6-8c02-818f77e27429 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:21:53.905044 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-75e19d65-eab0-45e6-8c02-818f77e27429 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:21:53.905473 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-75e19d65-eab0-45e6-8c02-818f77e27429 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:21:53.905902 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-75e19d65-eab0-45e6-8c02-818f77e27429 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:21:54.042790 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-75e19d65-eab0-45e6-8c02-818f77e27429 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:21:54.050879 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-75e19d65-eab0-45e6-8c02-818f77e27429 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5" status: 200 len: 1264 microversion: 2.1 time: 0.159408 Aug 31 13:21:54.051467 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 569/1111] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:21:53 2022] GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:21:54.139130 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-db6144fa-38d5-4ac4-8fa5-25d07acd1b54 req-e5e68ea8-9b45-4b5c-94ea-b2bd9aa543b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8a2a22b-1752-4a98-95cf-3acd9440b8c5", "tag": "88b450f6-8af9-4bd6-b5eb-d5001462a271"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:21:54.155080 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-db6144fa-38d5-4ac4-8fa5-25d07acd1b54 req-e5e68ea8-9b45-4b5c-94ea-b2bd9aa543b8 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:21:54.155559 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-db6144fa-38d5-4ac4-8fa5-25d07acd1b54 req-e5e68ea8-9b45-4b5c-94ea-b2bd9aa543b8 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:21:54.156019 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-db6144fa-38d5-4ac4-8fa5-25d07acd1b54 req-e5e68ea8-9b45-4b5c-94ea-b2bd9aa543b8 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:21:54.167222 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-db6144fa-38d5-4ac4-8fa5-25d07acd1b54 req-e5e68ea8-9b45-4b5c-94ea-b2bd9aa543b8 service nova] Creating event network-changed:88b450f6-8af9-4bd6-b5eb-d5001462a271 for instance c8a2a22b-1752-4a98-95cf-3acd9440b8c5 on hv-cinder-85442 Aug 31 13:21:54.172468 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-db6144fa-38d5-4ac4-8fa5-25d07acd1b54 req-e5e68ea8-9b45-4b5c-94ea-b2bd9aa543b8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037074 Aug 31 13:21:54.173072 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 543/1112] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:21:55.076185 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-e3ed4b91-2138-4e3c-b9dc-70f5c0c21a00 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:21:55.077194 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-e3ed4b91-2138-4e3c-b9dc-70f5c0c21a00 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: c8a2a22b-1752-4a98-95cf-3acd9440b8c5] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:21:55.090545 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e3ed4b91-2138-4e3c-b9dc-70f5c0c21a00 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:21:55.091325 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e3ed4b91-2138-4e3c-b9dc-70f5c0c21a00 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:21:55.092098 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e3ed4b91-2138-4e3c-b9dc-70f5c0c21a00 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:21:55.093231 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e3ed4b91-2138-4e3c-b9dc-70f5c0c21a00 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:21:55.094003 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e3ed4b91-2138-4e3c-b9dc-70f5c0c21a00 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:21:55.094694 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-e3ed4b91-2138-4e3c-b9dc-70f5c0c21a00 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:21:55.231136 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-e3ed4b91-2138-4e3c-b9dc-70f5c0c21a00 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:21:55.242746 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-e3ed4b91-2138-4e3c-b9dc-70f5c0c21a00 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5" status: 200 len: 1264 microversion: 2.1 time: 0.172935 Aug 31 13:21:55.243547 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 570/1113] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:21:55 2022] GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5 => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:21:56.270533 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b404a143-0154-4fc8-a0aa-2232292e1106 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:21:56.271342 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b404a143-0154-4fc8-a0aa-2232292e1106 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: c8a2a22b-1752-4a98-95cf-3acd9440b8c5] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:21:56.278865 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b404a143-0154-4fc8-a0aa-2232292e1106 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:21:56.279444 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b404a143-0154-4fc8-a0aa-2232292e1106 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:21:56.279990 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b404a143-0154-4fc8-a0aa-2232292e1106 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:21:56.280692 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b404a143-0154-4fc8-a0aa-2232292e1106 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:21:56.281144 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b404a143-0154-4fc8-a0aa-2232292e1106 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:21:56.281573 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-b404a143-0154-4fc8-a0aa-2232292e1106 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:21:56.420032 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-b404a143-0154-4fc8-a0aa-2232292e1106 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:21:56.428048 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b404a143-0154-4fc8-a0aa-2232292e1106 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5" status: 200 len: 1264 microversion: 2.1 time: 0.162416 Aug 31 13:21:56.428597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 544/1114] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:21:56 2022] GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:21:57.451941 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-d268291b-1c9b-487c-97a0-03478859cb71 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:21:57.452546 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-d268291b-1c9b-487c-97a0-03478859cb71 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: c8a2a22b-1752-4a98-95cf-3acd9440b8c5] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:21:57.459445 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d268291b-1c9b-487c-97a0-03478859cb71 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:21:57.459956 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d268291b-1c9b-487c-97a0-03478859cb71 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:21:57.460388 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d268291b-1c9b-487c-97a0-03478859cb71 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:21:57.461076 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d268291b-1c9b-487c-97a0-03478859cb71 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:21:57.461523 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d268291b-1c9b-487c-97a0-03478859cb71 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:21:57.461940 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d268291b-1c9b-487c-97a0-03478859cb71 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:21:57.602461 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-d268291b-1c9b-487c-97a0-03478859cb71 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:21:57.614188 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-d268291b-1c9b-487c-97a0-03478859cb71 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5" status: 200 len: 1264 microversion: 2.1 time: 0.166595 Aug 31 13:21:57.614921 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 571/1115] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:21:57 2022] GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:21:58.637945 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-646bac5a-53fc-41fe-acef-641d8967a76d tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:21:58.638568 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-646bac5a-53fc-41fe-acef-641d8967a76d tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: c8a2a22b-1752-4a98-95cf-3acd9440b8c5] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:21:58.640614 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=2 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:21:58.648963 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-646bac5a-53fc-41fe-acef-641d8967a76d tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:21:58.649604 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-646bac5a-53fc-41fe-acef-641d8967a76d tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:21:58.650203 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-646bac5a-53fc-41fe-acef-641d8967a76d tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:21:58.651299 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-646bac5a-53fc-41fe-acef-641d8967a76d tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:21:58.652360 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-646bac5a-53fc-41fe-acef-641d8967a76d tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:21:58.652876 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-646bac5a-53fc-41fe-acef-641d8967a76d tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:21:58.800258 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-646bac5a-53fc-41fe-acef-641d8967a76d tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:21:58.808538 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-646bac5a-53fc-41fe-acef-641d8967a76d tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5" status: 200 len: 1264 microversion: 2.1 time: 0.174606 Aug 31 13:21:58.809239 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 545/1116] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:21:58 2022] GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5 => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:21:59.840651 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-cce46c79-dc68-47f9-a210-970ee6053fab tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:21:59.841224 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-cce46c79-dc68-47f9-a210-970ee6053fab tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: c8a2a22b-1752-4a98-95cf-3acd9440b8c5] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:21:59.843878 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell0:SELECT=4 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:21:59.850412 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cce46c79-dc68-47f9-a210-970ee6053fab tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:21:59.850865 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cce46c79-dc68-47f9-a210-970ee6053fab tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:21:59.851282 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cce46c79-dc68-47f9-a210-970ee6053fab tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:21:59.851992 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cce46c79-dc68-47f9-a210-970ee6053fab tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:21:59.852429 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cce46c79-dc68-47f9-a210-970ee6053fab tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:21:59.852840 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cce46c79-dc68-47f9-a210-970ee6053fab tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:21:59.990571 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-cce46c79-dc68-47f9-a210-970ee6053fab tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:22:00.000777 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-cce46c79-dc68-47f9-a210-970ee6053fab tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5" status: 200 len: 1264 microversion: 2.1 time: 0.167718 Aug 31 13:22:00.001373 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 572/1117] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:21:59 2022] GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:22:01.034443 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-39b6dc75-76ed-4d05-ad03-769303f7bcf4 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:22:01.035421 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-39b6dc75-76ed-4d05-ad03-769303f7bcf4 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: c8a2a22b-1752-4a98-95cf-3acd9440b8c5] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:22:01.039236 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=10 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:22:01.046637 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-39b6dc75-76ed-4d05-ad03-769303f7bcf4 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:22:01.047109 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-39b6dc75-76ed-4d05-ad03-769303f7bcf4 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:22:01.047606 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-39b6dc75-76ed-4d05-ad03-769303f7bcf4 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:22:01.048311 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-39b6dc75-76ed-4d05-ad03-769303f7bcf4 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:22:01.048753 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-39b6dc75-76ed-4d05-ad03-769303f7bcf4 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:22:01.049172 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-39b6dc75-76ed-4d05-ad03-769303f7bcf4 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:22:01.186314 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-39b6dc75-76ed-4d05-ad03-769303f7bcf4 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:22:01.194683 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-39b6dc75-76ed-4d05-ad03-769303f7bcf4 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5" status: 200 len: 1264 microversion: 2.1 time: 0.167010 Aug 31 13:22:01.195264 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 546/1118] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:22:01 2022] GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:22:02.217772 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-6e223b4f-dddd-4b51-91c6-bd9c3b78362b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:22:02.218629 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-6e223b4f-dddd-4b51-91c6-bd9c3b78362b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: c8a2a22b-1752-4a98-95cf-3acd9440b8c5] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:22:02.227574 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6e223b4f-dddd-4b51-91c6-bd9c3b78362b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:22:02.228270 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6e223b4f-dddd-4b51-91c6-bd9c3b78362b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:22:02.228858 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6e223b4f-dddd-4b51-91c6-bd9c3b78362b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:22:02.229767 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6e223b4f-dddd-4b51-91c6-bd9c3b78362b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:22:02.230365 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6e223b4f-dddd-4b51-91c6-bd9c3b78362b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:22:02.230935 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6e223b4f-dddd-4b51-91c6-bd9c3b78362b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:22:02.370025 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-6e223b4f-dddd-4b51-91c6-bd9c3b78362b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:22:02.378494 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-6e223b4f-dddd-4b51-91c6-bd9c3b78362b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5" status: 200 len: 1264 microversion: 2.1 time: 0.166140 Aug 31 13:22:02.379073 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 573/1119] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:22:02 2022] GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:22:03.399392 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-1c16120d-d64b-49ad-a15c-519b340f8e0a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:22:03.400022 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-1c16120d-d64b-49ad-a15c-519b340f8e0a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: c8a2a22b-1752-4a98-95cf-3acd9440b8c5] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:22:03.407405 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1c16120d-d64b-49ad-a15c-519b340f8e0a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:22:03.407968 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1c16120d-d64b-49ad-a15c-519b340f8e0a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:22:03.408409 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1c16120d-d64b-49ad-a15c-519b340f8e0a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:22:03.409108 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1c16120d-d64b-49ad-a15c-519b340f8e0a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:22:03.409561 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1c16120d-d64b-49ad-a15c-519b340f8e0a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:22:03.409969 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1c16120d-d64b-49ad-a15c-519b340f8e0a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:22:03.549915 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-1c16120d-d64b-49ad-a15c-519b340f8e0a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:22:03.558014 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-1c16120d-d64b-49ad-a15c-519b340f8e0a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5" status: 200 len: 1264 microversion: 2.1 time: 0.162520 Aug 31 13:22:03.558738 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 547/1120] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:22:03 2022] GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:22:04.583094 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-15707adc-37e4-409d-8ceb-d2634fedb245 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:22:04.584067 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-15707adc-37e4-409d-8ceb-d2634fedb245 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: c8a2a22b-1752-4a98-95cf-3acd9440b8c5] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:22:04.593444 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-15707adc-37e4-409d-8ceb-d2634fedb245 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:22:04.593917 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-15707adc-37e4-409d-8ceb-d2634fedb245 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:22:04.594344 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-15707adc-37e4-409d-8ceb-d2634fedb245 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:22:04.595025 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-15707adc-37e4-409d-8ceb-d2634fedb245 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:22:04.595468 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-15707adc-37e4-409d-8ceb-d2634fedb245 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:22:04.595904 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-15707adc-37e4-409d-8ceb-d2634fedb245 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:22:04.731042 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-15707adc-37e4-409d-8ceb-d2634fedb245 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:22:04.739302 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-15707adc-37e4-409d-8ceb-d2634fedb245 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5" status: 200 len: 1264 microversion: 2.1 time: 0.162925 Aug 31 13:22:04.739874 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 574/1121] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:22:04 2022] GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:22:05.593275 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-9f610c06-fbf5-45e3-8868-dc7f6cfdd37b req-5c013277-16cb-4520-8f5d-b88958400611 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8a2a22b-1752-4a98-95cf-3acd9440b8c5", "name": "network-vif-plugged", "status": "completed", "tag": "88b450f6-8af9-4bd6-b5eb-d5001462a271"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:22:05.603737 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-9f610c06-fbf5-45e3-8868-dc7f6cfdd37b req-5c013277-16cb-4520-8f5d-b88958400611 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:22:05.604250 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-9f610c06-fbf5-45e3-8868-dc7f6cfdd37b req-5c013277-16cb-4520-8f5d-b88958400611 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:22:05.604655 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-9f610c06-fbf5-45e3-8868-dc7f6cfdd37b req-5c013277-16cb-4520-8f5d-b88958400611 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:22:05.616347 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-9f610c06-fbf5-45e3-8868-dc7f6cfdd37b req-5c013277-16cb-4520-8f5d-b88958400611 service nova] Creating event network-vif-plugged:88b450f6-8af9-4bd6-b5eb-d5001462a271 for instance c8a2a22b-1752-4a98-95cf-3acd9440b8c5 on hv-cinder-85442 Aug 31 13:22:05.621546 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-9f610c06-fbf5-45e3-8868-dc7f6cfdd37b req-5c013277-16cb-4520-8f5d-b88958400611 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031984 Aug 31 13:22:05.622169 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 548/1122] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:22:05.762926 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-00c50965-0ad8-433f-98e7-32ab6426b325 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:22:05.763947 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-00c50965-0ad8-433f-98e7-32ab6426b325 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: c8a2a22b-1752-4a98-95cf-3acd9440b8c5] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:22:05.773410 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-00c50965-0ad8-433f-98e7-32ab6426b325 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:22:05.774095 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-00c50965-0ad8-433f-98e7-32ab6426b325 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:22:05.774707 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-00c50965-0ad8-433f-98e7-32ab6426b325 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:22:05.775727 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-00c50965-0ad8-433f-98e7-32ab6426b325 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:22:05.776375 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-00c50965-0ad8-433f-98e7-32ab6426b325 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:22:05.777365 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-00c50965-0ad8-433f-98e7-32ab6426b325 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:22:05.914044 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-00c50965-0ad8-433f-98e7-32ab6426b325 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:22:05.932277 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-00c50965-0ad8-433f-98e7-32ab6426b325 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5" status: 200 len: 1264 microversion: 2.1 time: 0.174778 Aug 31 13:22:05.932916 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 575/1123] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:22:05 2022] GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5 => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:22:06.956255 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-2d8aeac3-5413-4d7e-a244-a66ee459556f tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:22:06.956955 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-2d8aeac3-5413-4d7e-a244-a66ee459556f tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: c8a2a22b-1752-4a98-95cf-3acd9440b8c5] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:22:06.963706 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2d8aeac3-5413-4d7e-a244-a66ee459556f tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:22:06.964210 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2d8aeac3-5413-4d7e-a244-a66ee459556f tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:22:06.964647 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2d8aeac3-5413-4d7e-a244-a66ee459556f tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:22:06.965332 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2d8aeac3-5413-4d7e-a244-a66ee459556f tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:22:06.965797 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2d8aeac3-5413-4d7e-a244-a66ee459556f tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:22:06.966307 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2d8aeac3-5413-4d7e-a244-a66ee459556f tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:22:07.113638 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-2d8aeac3-5413-4d7e-a244-a66ee459556f tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:22:07.124285 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-2d8aeac3-5413-4d7e-a244-a66ee459556f tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5" status: 200 len: 1264 microversion: 2.1 time: 0.172901 Aug 31 13:22:07.124866 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 549/1124] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:22:06 2022] GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5 => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:22:08.150494 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-2fed55fa-eb27-49cb-86ec-78f8013165f8 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:22:08.152141 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-2fed55fa-eb27-49cb-86ec-78f8013165f8 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: c8a2a22b-1752-4a98-95cf-3acd9440b8c5] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:22:08.159369 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2fed55fa-eb27-49cb-86ec-78f8013165f8 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:22:08.159884 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2fed55fa-eb27-49cb-86ec-78f8013165f8 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:22:08.160323 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2fed55fa-eb27-49cb-86ec-78f8013165f8 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:22:08.161029 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2fed55fa-eb27-49cb-86ec-78f8013165f8 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:22:08.161479 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2fed55fa-eb27-49cb-86ec-78f8013165f8 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:22:08.161896 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-2fed55fa-eb27-49cb-86ec-78f8013165f8 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:22:08.296490 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-2fed55fa-eb27-49cb-86ec-78f8013165f8 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:22:08.304452 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-2fed55fa-eb27-49cb-86ec-78f8013165f8 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5" status: 200 len: 1451 microversion: 2.1 time: 0.159026 Aug 31 13:22:08.305032 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 576/1125] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:22:08 2022] GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5 => generated 1451 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:22:08.324987 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-2803d1e6-898e-455d-be74-0308451de34b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:22:08.325640 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-2803d1e6-898e-455d-be74-0308451de34b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: c8a2a22b-1752-4a98-95cf-3acd9440b8c5] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:22:08.332368 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2803d1e6-898e-455d-be74-0308451de34b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:22:08.332851 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2803d1e6-898e-455d-be74-0308451de34b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:22:08.333248 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2803d1e6-898e-455d-be74-0308451de34b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:22:08.333975 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2803d1e6-898e-455d-be74-0308451de34b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:22:08.334421 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2803d1e6-898e-455d-be74-0308451de34b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:22:08.334841 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2803d1e6-898e-455d-be74-0308451de34b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:22:08.479738 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-2803d1e6-898e-455d-be74-0308451de34b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:22:08.488070 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-2803d1e6-898e-455d-be74-0308451de34b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5" status: 200 len: 1451 microversion: 2.1 time: 0.167039 Aug 31 13:22:08.488693 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 550/1126] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:22:08 2022] GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5 => generated 1451 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:22:10.486768 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-81d12e04-4cd5-4518-9280-c87cf999845f req-92a99bc1-af2a-4dda-a55d-0cb835feecc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8a2a22b-1752-4a98-95cf-3acd9440b8c5", "tag": "88b450f6-8af9-4bd6-b5eb-d5001462a271"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:22:10.496619 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-81d12e04-4cd5-4518-9280-c87cf999845f req-92a99bc1-af2a-4dda-a55d-0cb835feecc6 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:22:10.497557 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-81d12e04-4cd5-4518-9280-c87cf999845f req-92a99bc1-af2a-4dda-a55d-0cb835feecc6 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:22:10.497718 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-81d12e04-4cd5-4518-9280-c87cf999845f req-92a99bc1-af2a-4dda-a55d-0cb835feecc6 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:22:10.508794 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-81d12e04-4cd5-4518-9280-c87cf999845f req-92a99bc1-af2a-4dda-a55d-0cb835feecc6 service nova] Creating event network-changed:88b450f6-8af9-4bd6-b5eb-d5001462a271 for instance c8a2a22b-1752-4a98-95cf-3acd9440b8c5 on hv-cinder-85442 Aug 31 13:22:10.514006 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-81d12e04-4cd5-4518-9280-c87cf999845f req-92a99bc1-af2a-4dda-a55d-0cb835feecc6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030967 Aug 31 13:22:10.514708 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 577/1127] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:24:37.564815 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f9685a4a-455a-4764-a389-1722cce5526b] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 31 13:24:37.565783 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:24:37.566910 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=48 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:24:37.568227 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 13:24:37.568357 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Wed Aug 31 13:24:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5 (ip 10.222.0.58) !!! Aug 31 13:24:37.573565 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-d0538472-aa72-476e-8a1d-e99b6c85d1fd tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:24:37.574064 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-d0538472-aa72-476e-8a1d-e99b6c85d1fd tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: c8a2a22b-1752-4a98-95cf-3acd9440b8c5] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:24:37.582849 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d0538472-aa72-476e-8a1d-e99b6c85d1fd tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:24:37.583318 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d0538472-aa72-476e-8a1d-e99b6c85d1fd tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:24:37.583752 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d0538472-aa72-476e-8a1d-e99b6c85d1fd tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:24:37.584468 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d0538472-aa72-476e-8a1d-e99b6c85d1fd tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:24:37.584920 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d0538472-aa72-476e-8a1d-e99b6c85d1fd tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:24:37.585338 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d0538472-aa72-476e-8a1d-e99b6c85d1fd tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:24:37.611279 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-d0538472-aa72-476e-8a1d-e99b6c85d1fd tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: c8a2a22b-1752-4a98-95cf-3acd9440b8c5] Going to try to terminate instance {{(pid=120705) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 13:24:37.691172 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-d0538472-aa72-476e-8a1d-e99b6c85d1fd tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5" status: 204 len: 0 microversion: 2.1 time: 0.130140 Aug 31 13:24:37.691770 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 551/1128] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 31 13:24:37 2022] DELETE /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:24:37.698767 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR oslo.messaging._drivers.impl_rabbit [-] [21e1c21b-e7d8-4756-bb91-56a53e58253d] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 13:24:37.699341 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_api:SELECT=28 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:24:37.700132 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell1:SELECT=56 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:24:37.701361 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 13:24:37.701504 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Wed Aug 31 13:24:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5 (ip 10.222.0.58) !!! Aug 31 13:24:37.702604 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 13:24:37.702730 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Wed Aug 31 13:24:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5 (ip 10.222.0.58) !!! Aug 31 13:24:37.703650 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 13:24:37.703789 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Wed Aug 31 13:24:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5 (ip 10.222.0.58) !!! Aug 31 13:24:37.708845 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-4857bd9a-ab82-48f3-b438-6c397403d3f2 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:24:37.709575 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-4857bd9a-ab82-48f3-b438-6c397403d3f2 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: c8a2a22b-1752-4a98-95cf-3acd9440b8c5] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:24:37.721541 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4857bd9a-ab82-48f3-b438-6c397403d3f2 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:24:37.722015 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4857bd9a-ab82-48f3-b438-6c397403d3f2 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:24:37.722441 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4857bd9a-ab82-48f3-b438-6c397403d3f2 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:24:37.723124 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4857bd9a-ab82-48f3-b438-6c397403d3f2 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:24:37.723627 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4857bd9a-ab82-48f3-b438-6c397403d3f2 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:24:37.724071 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4857bd9a-ab82-48f3-b438-6c397403d3f2 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:24:37.920348 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-4857bd9a-ab82-48f3-b438-6c397403d3f2 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:24:37.928810 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-4857bd9a-ab82-48f3-b438-6c397403d3f2 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5" status: 200 len: 1576 microversion: 2.1 time: 0.232069 Aug 31 13:24:37.929507 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 578/1129] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:24:37 2022] GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5 => generated 1576 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:24:38.950252 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e833f8fd-5250-4e97-90b2-0b24cc484877 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:24:38.951285 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-e833f8fd-5250-4e97-90b2-0b24cc484877 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: c8a2a22b-1752-4a98-95cf-3acd9440b8c5] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:24:38.962388 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO oslo.messaging._drivers.impl_rabbit [-] [f9685a4a-455a-4764-a389-1722cce5526b] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 47132. Aug 31 13:24:38.966380 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e833f8fd-5250-4e97-90b2-0b24cc484877 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:24:38.966854 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e833f8fd-5250-4e97-90b2-0b24cc484877 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:24:38.967281 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e833f8fd-5250-4e97-90b2-0b24cc484877 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:24:38.968016 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e833f8fd-5250-4e97-90b2-0b24cc484877 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:24:38.968461 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e833f8fd-5250-4e97-90b2-0b24cc484877 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:24:38.968873 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-e833f8fd-5250-4e97-90b2-0b24cc484877 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:24:39.156372 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-e833f8fd-5250-4e97-90b2-0b24cc484877 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:24:39.164577 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e833f8fd-5250-4e97-90b2-0b24cc484877 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5" status: 200 len: 1576 microversion: 2.1 time: 0.218695 Aug 31 13:24:39.165185 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 552/1130] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:24:38 2022] GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5 => generated 1576 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:24:40.185942 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-eb1d91a6-0e68-4b4c-ad0c-5044b8690c9b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:24:40.186497 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-eb1d91a6-0e68-4b4c-ad0c-5044b8690c9b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: c8a2a22b-1752-4a98-95cf-3acd9440b8c5] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:24:40.194771 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-eb1d91a6-0e68-4b4c-ad0c-5044b8690c9b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:24:40.195196 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-eb1d91a6-0e68-4b4c-ad0c-5044b8690c9b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:24:40.195616 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-eb1d91a6-0e68-4b4c-ad0c-5044b8690c9b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:24:40.196336 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-eb1d91a6-0e68-4b4c-ad0c-5044b8690c9b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:24:40.196803 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-eb1d91a6-0e68-4b4c-ad0c-5044b8690c9b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:24:40.197211 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-eb1d91a6-0e68-4b4c-ad0c-5044b8690c9b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:24:40.203177 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO oslo.messaging._drivers.impl_rabbit [-] [21e1c21b-e7d8-4756-bb91-56a53e58253d] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 47138. Aug 31 13:24:40.349466 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-eb1d91a6-0e68-4b4c-ad0c-5044b8690c9b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:24:40.357722 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-eb1d91a6-0e68-4b4c-ad0c-5044b8690c9b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5" status: 200 len: 1576 microversion: 2.1 time: 0.175772 Aug 31 13:24:40.358316 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 579/1131] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:24:40 2022] GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5 => generated 1576 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:24:40.918684 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-940c1862-069e-4cca-a912-64b24b339b1d req-fda4510f-5e76-4f5a-b368-7835c3d280ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8a2a22b-1752-4a98-95cf-3acd9440b8c5", "name": "network-vif-deleted", "tag": "88b450f6-8af9-4bd6-b5eb-d5001462a271"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:24:40.928924 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-940c1862-069e-4cca-a912-64b24b339b1d req-fda4510f-5e76-4f5a-b368-7835c3d280ef service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:24:40.929382 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-940c1862-069e-4cca-a912-64b24b339b1d req-fda4510f-5e76-4f5a-b368-7835c3d280ef service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:24:40.929826 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-940c1862-069e-4cca-a912-64b24b339b1d req-fda4510f-5e76-4f5a-b368-7835c3d280ef service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:24:40.941849 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-940c1862-069e-4cca-a912-64b24b339b1d req-fda4510f-5e76-4f5a-b368-7835c3d280ef service nova] Creating event network-vif-deleted:88b450f6-8af9-4bd6-b5eb-d5001462a271 for instance c8a2a22b-1752-4a98-95cf-3acd9440b8c5 on hv-cinder-85442 Aug 31 13:24:40.946738 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-940c1862-069e-4cca-a912-64b24b339b1d req-fda4510f-5e76-4f5a-b368-7835c3d280ef service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031677 Aug 31 13:24:40.947571 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 553/1132] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:24:41.378774 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-4c855dd7-f02f-40d2-84fb-fa77bdae0902 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:24:41.379530 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-4c855dd7-f02f-40d2-84fb-fa77bdae0902 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: c8a2a22b-1752-4a98-95cf-3acd9440b8c5] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:24:41.386226 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4c855dd7-f02f-40d2-84fb-fa77bdae0902 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:24:41.386825 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4c855dd7-f02f-40d2-84fb-fa77bdae0902 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:24:41.387352 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4c855dd7-f02f-40d2-84fb-fa77bdae0902 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:24:41.388181 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4c855dd7-f02f-40d2-84fb-fa77bdae0902 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:24:41.388724 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4c855dd7-f02f-40d2-84fb-fa77bdae0902 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:24:41.389256 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-4c855dd7-f02f-40d2-84fb-fa77bdae0902 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:24:41.460817 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-4c855dd7-f02f-40d2-84fb-fa77bdae0902 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:24:41.469251 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-4c855dd7-f02f-40d2-84fb-fa77bdae0902 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5" status: 200 len: 1223 microversion: 2.1 time: 0.094407 Aug 31 13:24:41.469840 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 580/1133] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:24:41 2022] GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5 => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:24:42.495700 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-5f3aad62-79e6-49f0-91cd-2a2fb592f54b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:24:42.496942 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-5f3aad62-79e6-49f0-91cd-2a2fb592f54b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: c8a2a22b-1752-4a98-95cf-3acd9440b8c5] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:24:42.507883 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5f3aad62-79e6-49f0-91cd-2a2fb592f54b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:24:42.508648 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5f3aad62-79e6-49f0-91cd-2a2fb592f54b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:24:42.509350 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5f3aad62-79e6-49f0-91cd-2a2fb592f54b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:24:42.510464 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5f3aad62-79e6-49f0-91cd-2a2fb592f54b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:24:42.511198 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5f3aad62-79e6-49f0-91cd-2a2fb592f54b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:24:42.511889 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5f3aad62-79e6-49f0-91cd-2a2fb592f54b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:24:42.529254 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-5f3aad62-79e6-49f0-91cd-2a2fb592f54b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] HTTP exception thrown: Instance c8a2a22b-1752-4a98-95cf-3acd9440b8c5 could not be found. Aug 31 13:24:42.530850 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-5f3aad62-79e6-49f0-91cd-2a2fb592f54b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Request method failure captured: Aug 31 13:24:42.530850 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: request: GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5 HTTP/1.1 Aug 31 13:24:42.530850 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 31 13:24:42.530850 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 31 13:24:42.530850 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Connection: close Aug 31 13:24:42.530850 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 31 13:24:42.530850 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 31 13:24:42.530850 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Host: 10.222.0.58 Aug 31 13:24:42.530850 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 31 13:24:42.530850 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 31 13:24:42.530850 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjD2BMY2mL45QxnSD5LwCJvxzdtYzv5IXt87L0KdlrP9plSRC5YyREmTzryZzEfk_gpa-ONx3o2mJIAiABxvQ8xNIew9m3lkBpGkjoFfdSDHzdkvWNeIXDHh2tTnLRl0jXuSMjC-uSkFrdwwaSQX69I38bhGAd-Q0Rr_sLrzIlaBNzBOM Aug 31 13:24:42.530850 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 31 13:24:42.530850 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 31 13:24:42.530850 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 31 13:24:42.530850 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 31 13:24:42.530850 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 31 13:24:42.530850 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 31 13:24:42.530850 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Id: b83394c784464c69843feac5ed7050dd Aug 31 13:24:42.530850 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-TestVolumeBootPattern-1699852126 Aug 31 13:24:42.530850 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Role: member,reader Aug 31 13:24:42.530850 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Roles: member,reader Aug 31 13:24:42.532717 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b83394c784464c69843feac5ed7050dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b83394c784464c69843feac5ed7050dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b83394c784464c69843feac5ed7050dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b83394c784464c69843feac5ed7050dd"}]}] Aug 31 13:24:42.532717 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-TestVolumeBootPattern-1699852126 Aug 31 13:24:42.532717 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant-Id: b83394c784464c69843feac5ed7050dd Aug 31 13:24:42.532717 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-TestVolumeBootPattern-1699852126 Aug 31 13:24:42.532717 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User: tempest-TestVolumeBootPattern-1699852126-project Aug 31 13:24:42.532717 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 31 13:24:42.532717 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 31 13:24:42.532717 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Id: e6897b60675a4c99a47ed51cdcbd1d39 Aug 31 13:24:42.532717 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-TestVolumeBootPattern-1699852126-project Aug 31 13:24:42.532717 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: method: > Aug 31 13:24:42.532717 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: exception: Instance c8a2a22b-1752-4a98-95cf-3acd9440b8c5 could not be found. Aug 31 13:24:42.532717 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: action_args: {'id': 'c8a2a22b-1752-4a98-95cf-3acd9440b8c5'} Aug 31 13:24:42.533828 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:24:42.533828 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:24:42.533828 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 13:24:42.533828 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 13:24:42.533828 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 13:24:42.533828 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 13:24:42.533828 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 13:24:42.533828 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 13:24:42.533828 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 13:24:42.533828 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 13:24:42.533828 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8a2a22b-1752-4a98-95cf-3acd9440b8c5 could not be found. Aug 31 13:24:42.533828 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:24:42.533828 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:24:42.533828 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:24:42.533828 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:24:42.533828 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:24:42.533828 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:24:42.533828 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:24:42.533828 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:24:42.533828 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:24:42.535527 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:24:42.535527 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 13:24:42.535527 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 13:24:42.535527 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 13:24:42.535527 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 13:24:42.535527 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 13:24:42.535527 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 13:24:42.535527 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8a2a22b-1752-4a98-95cf-3acd9440b8c5 could not be found. Aug 31 13:24:42.535527 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:24:42.535527 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:24:42.535527 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:24:42.535527 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:24:42.535527 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:24:42.535527 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:24:42.535527 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:24:42.535527 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:24:42.535527 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8a2a22b-1752-4a98-95cf-3acd9440b8c5 could not be found. Aug 31 13:24:42.535527 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:24:42.537109 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-5f3aad62-79e6-49f0-91cd-2a2fb592f54b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Returning 404 to user: Instance c8a2a22b-1752-4a98-95cf-3acd9440b8c5 could not be found. {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:24:42.537109 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-5f3aad62-79e6-49f0-91cd-2a2fb592f54b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5" status: 404 len: 111 microversion: 2.1 time: 0.044485 Aug 31 13:24:42.537109 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 554/1134] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:24:42 2022] GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:24:42.584161 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-6cbc9115-7ddf-49a4-ad8e-8e91401a3b31 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1912517162", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-79203537", "security_groups": [{"name": "tempest-secgroup-smoke-1471111224"}], "block_device_mapping_v2": [{"uuid": "ea6af283-af90-4623-9bc0-beaca91c361f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c8f7a1ff-b0b8-4c3a-b081-57ae0e3ac414"}]}} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:24:42.705570 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.network.neutron [None req-6cbc9115-7ddf-49a4-ad8e-8e91401a3b31 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] validate_networks() for [('c8f7a1ff-b0b8-4c3a-b081-57ae0e3ac414', None, None, None, None, None)] {{(pid=120704) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 13:24:43.140400 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.virt.hardware [None req-6cbc9115-7ddf-49a4-ad8e-8e91401a3b31 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Flavor limits 0:0:0 {{(pid=120704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 13:24:43.140825 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.virt.hardware [None req-6cbc9115-7ddf-49a4-ad8e-8e91401a3b31 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Image limits 0:0:0 {{(pid=120704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 13:24:43.141291 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.virt.hardware [None req-6cbc9115-7ddf-49a4-ad8e-8e91401a3b31 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Flavor pref 0:0:0 {{(pid=120704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 13:24:43.141692 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.virt.hardware [None req-6cbc9115-7ddf-49a4-ad8e-8e91401a3b31 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Image pref 0:0:0 {{(pid=120704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 13:24:43.142098 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.virt.hardware [None req-6cbc9115-7ddf-49a4-ad8e-8e91401a3b31 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 13:24:43.151915 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6cbc9115-7ddf-49a4-ad8e-8e91401a3b31 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:24:43.152394 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6cbc9115-7ddf-49a4-ad8e-8e91401a3b31 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:24:43.152822 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6cbc9115-7ddf-49a4-ad8e-8e91401a3b31 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:24:43.153704 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6cbc9115-7ddf-49a4-ad8e-8e91401a3b31 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:24:43.154161 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6cbc9115-7ddf-49a4-ad8e-8e91401a3b31 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:24:43.154577 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6cbc9115-7ddf-49a4-ad8e-8e91401a3b31 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:24:43.171385 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.quota [None req-6cbc9115-7ddf-49a4-ad8e-8e91401a3b31 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Getting quotas for project b83394c784464c69843feac5ed7050dd. Resources: {'instances', 'ram', 'cores'} {{(pid=120704) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 13:24:43.175467 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.quota [None req-6cbc9115-7ddf-49a4-ad8e-8e91401a3b31 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Getting quotas for user e6897b60675a4c99a47ed51cdcbd1d39 and project b83394c784464c69843feac5ed7050dd. Resources: {'instances', 'ram', 'cores'} {{(pid=120704) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 13:24:43.232936 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-6cbc9115-7ddf-49a4-ad8e-8e91401a3b31 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Going to run 1 instances... {{(pid=120704) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 13:24:43.235055 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-6cbc9115-7ddf-49a4-ad8e-8e91401a3b31 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: bca89234-9e28-499e-b408-3aa8576cd818] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ea6af283-af90-4623-9bc0-beaca91c361f',volume_size=None,volume_type=None)] {{(pid=120704) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 13:24:43.385316 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-6cbc9115-7ddf-49a4-ad8e-8e91401a3b31 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.805066 Aug 31 13:24:43.385946 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 581/1135] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 31 13:24:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 13:24:43.397039 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-b7a4fbb4-9400-4a78-aa4a-039b7c86a810 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:24:43.397554 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-b7a4fbb4-9400-4a78-aa4a-039b7c86a810 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: bca89234-9e28-499e-b408-3aa8576cd818] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:24:43.452305 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-b7a4fbb4-9400-4a78-aa4a-039b7c86a810 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:24:43.460669 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-b7a4fbb4-9400-4a78-aa4a-039b7c86a810 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/bca89234-9e28-499e-b408-3aa8576cd818" status: 200 len: 1093 microversion: 2.1 time: 0.067312 Aug 31 13:24:43.463150 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 555/1136] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:24:43 2022] GET /compute/v2.1/servers/bca89234-9e28-499e-b408-3aa8576cd818 => generated 1093 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:24:44.489357 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-73811323-7a92-4545-994c-2dc8b3d69b37 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:24:44.489976 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-73811323-7a92-4545-994c-2dc8b3d69b37 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: bca89234-9e28-499e-b408-3aa8576cd818] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:24:44.496472 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-73811323-7a92-4545-994c-2dc8b3d69b37 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:24:44.497248 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-73811323-7a92-4545-994c-2dc8b3d69b37 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:24:44.497688 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-73811323-7a92-4545-994c-2dc8b3d69b37 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:24:44.498482 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-73811323-7a92-4545-994c-2dc8b3d69b37 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:24:44.498934 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-73811323-7a92-4545-994c-2dc8b3d69b37 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:24:44.499389 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-73811323-7a92-4545-994c-2dc8b3d69b37 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:24:44.571444 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-73811323-7a92-4545-994c-2dc8b3d69b37 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:24:44.582463 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-73811323-7a92-4545-994c-2dc8b3d69b37 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/bca89234-9e28-499e-b408-3aa8576cd818" status: 200 len: 1191 microversion: 2.1 time: 0.097344 Aug 31 13:24:44.583193 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 582/1137] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:24:44 2022] GET /compute/v2.1/servers/bca89234-9e28-499e-b408-3aa8576cd818 => generated 1191 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:24:45.603723 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-57be4215-6aa4-4f77-8bfa-8bb7e8b1b90a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:24:45.604459 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-57be4215-6aa4-4f77-8bfa-8bb7e8b1b90a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: bca89234-9e28-499e-b408-3aa8576cd818] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:24:45.612753 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-57be4215-6aa4-4f77-8bfa-8bb7e8b1b90a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:24:45.613323 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-57be4215-6aa4-4f77-8bfa-8bb7e8b1b90a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:24:45.613832 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-57be4215-6aa4-4f77-8bfa-8bb7e8b1b90a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:24:45.614613 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-57be4215-6aa4-4f77-8bfa-8bb7e8b1b90a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:24:45.615122 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-57be4215-6aa4-4f77-8bfa-8bb7e8b1b90a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:24:45.615621 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-57be4215-6aa4-4f77-8bfa-8bb7e8b1b90a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:24:45.750152 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-57be4215-6aa4-4f77-8bfa-8bb7e8b1b90a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:24:45.760092 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-57be4215-6aa4-4f77-8bfa-8bb7e8b1b90a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/bca89234-9e28-499e-b408-3aa8576cd818" status: 200 len: 1265 microversion: 2.1 time: 0.160240 Aug 31 13:24:45.760757 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 556/1138] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:24:45 2022] GET /compute/v2.1/servers/bca89234-9e28-499e-b408-3aa8576cd818 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:24:45.972595 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-2ae8c3c4-ed1a-4de8-a93b-f03b228d98bb req-5209f421-13cc-4218-81a3-7d2dfd2a9370 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bca89234-9e28-499e-b408-3aa8576cd818", "tag": "4ebcdce5-d076-425a-8235-89c452379b09"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:24:45.984956 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-2ae8c3c4-ed1a-4de8-a93b-f03b228d98bb req-5209f421-13cc-4218-81a3-7d2dfd2a9370 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:24:45.985419 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-2ae8c3c4-ed1a-4de8-a93b-f03b228d98bb req-5209f421-13cc-4218-81a3-7d2dfd2a9370 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:24:45.985942 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-2ae8c3c4-ed1a-4de8-a93b-f03b228d98bb req-5209f421-13cc-4218-81a3-7d2dfd2a9370 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:24:45.998731 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-2ae8c3c4-ed1a-4de8-a93b-f03b228d98bb req-5209f421-13cc-4218-81a3-7d2dfd2a9370 service nova] Creating event network-changed:4ebcdce5-d076-425a-8235-89c452379b09 for instance bca89234-9e28-499e-b408-3aa8576cd818 on hv-cinder-85442 Aug 31 13:24:46.005389 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-2ae8c3c4-ed1a-4de8-a93b-f03b228d98bb req-5209f421-13cc-4218-81a3-7d2dfd2a9370 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036734 Aug 31 13:24:46.006056 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 583/1139] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:24:46.782103 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-d5899629-29d0-424b-be40-f3fb57ccec8a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:24:46.782839 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-d5899629-29d0-424b-be40-f3fb57ccec8a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: bca89234-9e28-499e-b408-3aa8576cd818] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:24:46.789658 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d5899629-29d0-424b-be40-f3fb57ccec8a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:24:46.790142 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d5899629-29d0-424b-be40-f3fb57ccec8a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:24:46.790580 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d5899629-29d0-424b-be40-f3fb57ccec8a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:24:46.791271 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d5899629-29d0-424b-be40-f3fb57ccec8a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:24:46.791720 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d5899629-29d0-424b-be40-f3fb57ccec8a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:24:46.792185 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d5899629-29d0-424b-be40-f3fb57ccec8a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:24:46.930144 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-d5899629-29d0-424b-be40-f3fb57ccec8a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:24:46.938270 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-d5899629-29d0-424b-be40-f3fb57ccec8a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/bca89234-9e28-499e-b408-3aa8576cd818" status: 200 len: 1265 microversion: 2.1 time: 0.160158 Aug 31 13:24:46.938991 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 557/1140] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:24:46 2022] GET /compute/v2.1/servers/bca89234-9e28-499e-b408-3aa8576cd818 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:24:47.959995 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-09898975-c4a2-4f8a-a521-f50dd5ca0181 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:24:47.960686 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-09898975-c4a2-4f8a-a521-f50dd5ca0181 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: bca89234-9e28-499e-b408-3aa8576cd818] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:24:47.967230 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-09898975-c4a2-4f8a-a521-f50dd5ca0181 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:24:47.967702 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-09898975-c4a2-4f8a-a521-f50dd5ca0181 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:24:47.968189 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-09898975-c4a2-4f8a-a521-f50dd5ca0181 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:24:47.968878 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-09898975-c4a2-4f8a-a521-f50dd5ca0181 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:24:47.969320 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-09898975-c4a2-4f8a-a521-f50dd5ca0181 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:24:47.969707 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-09898975-c4a2-4f8a-a521-f50dd5ca0181 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:24:48.106422 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-09898975-c4a2-4f8a-a521-f50dd5ca0181 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:24:48.114340 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-09898975-c4a2-4f8a-a521-f50dd5ca0181 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/bca89234-9e28-499e-b408-3aa8576cd818" status: 200 len: 1265 microversion: 2.1 time: 0.159219 Aug 31 13:24:48.114932 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 584/1141] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:24:47 2022] GET /compute/v2.1/servers/bca89234-9e28-499e-b408-3aa8576cd818 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:24:49.139192 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-a5b0801c-0658-4c0b-9f92-7998fabfa0d6 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:24:49.140260 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-a5b0801c-0658-4c0b-9f92-7998fabfa0d6 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: bca89234-9e28-499e-b408-3aa8576cd818] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:24:49.149324 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a5b0801c-0658-4c0b-9f92-7998fabfa0d6 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:24:49.150139 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a5b0801c-0658-4c0b-9f92-7998fabfa0d6 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:24:49.150572 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a5b0801c-0658-4c0b-9f92-7998fabfa0d6 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:24:49.151246 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a5b0801c-0658-4c0b-9f92-7998fabfa0d6 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:24:49.151687 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a5b0801c-0658-4c0b-9f92-7998fabfa0d6 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:24:49.152131 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-a5b0801c-0658-4c0b-9f92-7998fabfa0d6 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:24:49.288151 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-a5b0801c-0658-4c0b-9f92-7998fabfa0d6 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:24:49.300280 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-a5b0801c-0658-4c0b-9f92-7998fabfa0d6 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/bca89234-9e28-499e-b408-3aa8576cd818" status: 200 len: 1265 microversion: 2.1 time: 0.167209 Aug 31 13:24:49.301059 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 558/1142] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:24:49 2022] GET /compute/v2.1/servers/bca89234-9e28-499e-b408-3aa8576cd818 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:24:50.325841 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-c23c4d03-1e6a-4987-bf97-8c8d835c5ff7 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:24:50.326767 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-c23c4d03-1e6a-4987-bf97-8c8d835c5ff7 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: bca89234-9e28-499e-b408-3aa8576cd818] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:24:50.337669 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c23c4d03-1e6a-4987-bf97-8c8d835c5ff7 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:24:50.338533 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c23c4d03-1e6a-4987-bf97-8c8d835c5ff7 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:24:50.339198 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c23c4d03-1e6a-4987-bf97-8c8d835c5ff7 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:24:50.340375 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c23c4d03-1e6a-4987-bf97-8c8d835c5ff7 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:24:50.341108 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c23c4d03-1e6a-4987-bf97-8c8d835c5ff7 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:24:50.341808 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-c23c4d03-1e6a-4987-bf97-8c8d835c5ff7 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:24:50.491700 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-c23c4d03-1e6a-4987-bf97-8c8d835c5ff7 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:24:50.500312 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-c23c4d03-1e6a-4987-bf97-8c8d835c5ff7 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/bca89234-9e28-499e-b408-3aa8576cd818" status: 200 len: 1265 microversion: 2.1 time: 0.181228 Aug 31 13:24:50.500894 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 585/1143] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:24:50 2022] GET /compute/v2.1/servers/bca89234-9e28-499e-b408-3aa8576cd818 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:24:51.522279 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-0a8f5b86-e050-4eb4-a2ec-89ebd66d1a07 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:24:51.523013 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-0a8f5b86-e050-4eb4-a2ec-89ebd66d1a07 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: bca89234-9e28-499e-b408-3aa8576cd818] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:24:51.530723 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0a8f5b86-e050-4eb4-a2ec-89ebd66d1a07 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:24:51.531204 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0a8f5b86-e050-4eb4-a2ec-89ebd66d1a07 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:24:51.531635 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0a8f5b86-e050-4eb4-a2ec-89ebd66d1a07 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:24:51.532376 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0a8f5b86-e050-4eb4-a2ec-89ebd66d1a07 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:24:51.532820 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0a8f5b86-e050-4eb4-a2ec-89ebd66d1a07 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:24:51.533219 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-0a8f5b86-e050-4eb4-a2ec-89ebd66d1a07 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:24:51.688057 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-0a8f5b86-e050-4eb4-a2ec-89ebd66d1a07 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:24:51.697239 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-0a8f5b86-e050-4eb4-a2ec-89ebd66d1a07 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/bca89234-9e28-499e-b408-3aa8576cd818" status: 200 len: 1265 microversion: 2.1 time: 0.179765 Aug 31 13:24:51.698053 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 559/1144] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:24:51 2022] GET /compute/v2.1/servers/bca89234-9e28-499e-b408-3aa8576cd818 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:24:52.726689 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-6127889c-ea9d-420d-851f-c80f0b274590 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:24:52.727257 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-6127889c-ea9d-420d-851f-c80f0b274590 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: bca89234-9e28-499e-b408-3aa8576cd818] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:24:52.734631 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6127889c-ea9d-420d-851f-c80f0b274590 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:24:52.735104 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6127889c-ea9d-420d-851f-c80f0b274590 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:24:52.735531 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6127889c-ea9d-420d-851f-c80f0b274590 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:24:52.736265 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6127889c-ea9d-420d-851f-c80f0b274590 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:24:52.736703 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6127889c-ea9d-420d-851f-c80f0b274590 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:24:52.737109 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-6127889c-ea9d-420d-851f-c80f0b274590 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:24:52.874261 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-6127889c-ea9d-420d-851f-c80f0b274590 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:24:52.882146 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-6127889c-ea9d-420d-851f-c80f0b274590 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/bca89234-9e28-499e-b408-3aa8576cd818" status: 200 len: 1265 microversion: 2.1 time: 0.160316 Aug 31 13:24:52.882726 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 586/1145] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:24:52 2022] GET /compute/v2.1/servers/bca89234-9e28-499e-b408-3aa8576cd818 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:24:53.907686 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-f580d162-0c9e-4ce4-94d0-0529e2975fca tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:24:53.908935 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-f580d162-0c9e-4ce4-94d0-0529e2975fca tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: bca89234-9e28-499e-b408-3aa8576cd818] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:24:53.912253 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=2 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:24:53.918040 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f580d162-0c9e-4ce4-94d0-0529e2975fca tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:24:53.918541 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f580d162-0c9e-4ce4-94d0-0529e2975fca tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:24:53.918974 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f580d162-0c9e-4ce4-94d0-0529e2975fca tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:24:53.919678 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f580d162-0c9e-4ce4-94d0-0529e2975fca tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:24:53.920140 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f580d162-0c9e-4ce4-94d0-0529e2975fca tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:24:53.920950 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-f580d162-0c9e-4ce4-94d0-0529e2975fca tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:24:54.060402 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-f580d162-0c9e-4ce4-94d0-0529e2975fca tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:24:54.068463 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-f580d162-0c9e-4ce4-94d0-0529e2975fca tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/bca89234-9e28-499e-b408-3aa8576cd818" status: 200 len: 1265 microversion: 2.1 time: 0.167288 Aug 31 13:24:54.069059 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 560/1146] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:24:53 2022] GET /compute/v2.1/servers/bca89234-9e28-499e-b408-3aa8576cd818 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:24:55.091470 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-42165114-dbdc-4fce-8883-840e3a4118f3 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:24:55.092226 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-42165114-dbdc-4fce-8883-840e3a4118f3 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: bca89234-9e28-499e-b408-3aa8576cd818] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:24:55.094665 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell0:SELECT=2 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:24:55.095570 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell0:SELECT=6 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:24:55.104656 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-42165114-dbdc-4fce-8883-840e3a4118f3 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:24:55.105350 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-42165114-dbdc-4fce-8883-840e3a4118f3 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:24:55.105932 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-42165114-dbdc-4fce-8883-840e3a4118f3 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:24:55.106841 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-42165114-dbdc-4fce-8883-840e3a4118f3 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:24:55.107434 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-42165114-dbdc-4fce-8883-840e3a4118f3 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:24:55.108029 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-42165114-dbdc-4fce-8883-840e3a4118f3 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:24:55.246632 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-42165114-dbdc-4fce-8883-840e3a4118f3 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:24:55.258801 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-42165114-dbdc-4fce-8883-840e3a4118f3 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/bca89234-9e28-499e-b408-3aa8576cd818" status: 200 len: 1265 microversion: 2.1 time: 0.172493 Aug 31 13:24:55.259603 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 587/1147] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:24:55 2022] GET /compute/v2.1/servers/bca89234-9e28-499e-b408-3aa8576cd818 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:24:56.242992 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-186fab8a-b166-4193-bbec-78adb4b3a0f6 req-68fd5d2f-6f27-46c4-8e66-83092cf94e14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bca89234-9e28-499e-b408-3aa8576cd818", "name": "network-vif-plugged", "status": "completed", "tag": "4ebcdce5-d076-425a-8235-89c452379b09"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:24:56.252670 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-186fab8a-b166-4193-bbec-78adb4b3a0f6 req-68fd5d2f-6f27-46c4-8e66-83092cf94e14 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:24:56.253131 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-186fab8a-b166-4193-bbec-78adb4b3a0f6 req-68fd5d2f-6f27-46c4-8e66-83092cf94e14 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:24:56.253557 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-186fab8a-b166-4193-bbec-78adb4b3a0f6 req-68fd5d2f-6f27-46c4-8e66-83092cf94e14 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:24:56.264698 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-186fab8a-b166-4193-bbec-78adb4b3a0f6 req-68fd5d2f-6f27-46c4-8e66-83092cf94e14 service nova] Creating event network-vif-plugged:4ebcdce5-d076-425a-8235-89c452379b09 for instance bca89234-9e28-499e-b408-3aa8576cd818 on hv-cinder-85442 Aug 31 13:24:56.270100 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-186fab8a-b166-4193-bbec-78adb4b3a0f6 req-68fd5d2f-6f27-46c4-8e66-83092cf94e14 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093563 Aug 31 13:24:56.270730 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 561/1148] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:24:56.284146 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-22f141ae-189c-4f75-99a4-11e8d9dad4d9 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:24:56.284752 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-22f141ae-189c-4f75-99a4-11e8d9dad4d9 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: bca89234-9e28-499e-b408-3aa8576cd818] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:24:56.291383 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-22f141ae-189c-4f75-99a4-11e8d9dad4d9 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:24:56.291834 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-22f141ae-189c-4f75-99a4-11e8d9dad4d9 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:24:56.292290 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-22f141ae-189c-4f75-99a4-11e8d9dad4d9 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:24:56.292960 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-22f141ae-189c-4f75-99a4-11e8d9dad4d9 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:24:56.293396 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-22f141ae-189c-4f75-99a4-11e8d9dad4d9 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:24:56.293803 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-22f141ae-189c-4f75-99a4-11e8d9dad4d9 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:24:56.435805 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-22f141ae-189c-4f75-99a4-11e8d9dad4d9 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:24:56.447608 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-22f141ae-189c-4f75-99a4-11e8d9dad4d9 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/bca89234-9e28-499e-b408-3aa8576cd818" status: 200 len: 1265 microversion: 2.1 time: 0.166955 Aug 31 13:24:56.448732 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 588/1149] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:24:56 2022] GET /compute/v2.1/servers/bca89234-9e28-499e-b408-3aa8576cd818 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:24:57.484735 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-4207de06-6979-421b-9f24-b73d9968af70 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:24:57.485887 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-4207de06-6979-421b-9f24-b73d9968af70 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: bca89234-9e28-499e-b408-3aa8576cd818] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:24:57.494293 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4207de06-6979-421b-9f24-b73d9968af70 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:24:57.494742 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4207de06-6979-421b-9f24-b73d9968af70 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:24:57.495182 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4207de06-6979-421b-9f24-b73d9968af70 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:24:57.495871 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4207de06-6979-421b-9f24-b73d9968af70 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:24:57.496345 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4207de06-6979-421b-9f24-b73d9968af70 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:24:57.496766 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4207de06-6979-421b-9f24-b73d9968af70 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:24:57.654483 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-4207de06-6979-421b-9f24-b73d9968af70 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:24:57.662629 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-4207de06-6979-421b-9f24-b73d9968af70 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/bca89234-9e28-499e-b408-3aa8576cd818" status: 200 len: 1265 microversion: 2.1 time: 0.185876 Aug 31 13:24:57.663185 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 562/1150] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:24:57 2022] GET /compute/v2.1/servers/bca89234-9e28-499e-b408-3aa8576cd818 => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:24:58.687325 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-bc8497a1-e757-4804-957d-c6ec83aecd11 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:24:58.687992 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-bc8497a1-e757-4804-957d-c6ec83aecd11 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: bca89234-9e28-499e-b408-3aa8576cd818] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:24:58.695351 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bc8497a1-e757-4804-957d-c6ec83aecd11 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:24:58.695853 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bc8497a1-e757-4804-957d-c6ec83aecd11 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:24:58.696264 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bc8497a1-e757-4804-957d-c6ec83aecd11 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:24:58.696961 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bc8497a1-e757-4804-957d-c6ec83aecd11 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:24:58.697413 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bc8497a1-e757-4804-957d-c6ec83aecd11 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:24:58.697835 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bc8497a1-e757-4804-957d-c6ec83aecd11 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:24:58.848847 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-bc8497a1-e757-4804-957d-c6ec83aecd11 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:24:58.857249 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-bc8497a1-e757-4804-957d-c6ec83aecd11 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/bca89234-9e28-499e-b408-3aa8576cd818" status: 200 len: 1453 microversion: 2.1 time: 0.174387 Aug 31 13:24:58.857837 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 589/1151] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:24:58 2022] GET /compute/v2.1/servers/bca89234-9e28-499e-b408-3aa8576cd818 => generated 1453 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:24:58.877379 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-effa83f7-1830-4d14-8f8b-79bd6e7768bb tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:24:58.877955 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-effa83f7-1830-4d14-8f8b-79bd6e7768bb tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: bca89234-9e28-499e-b408-3aa8576cd818] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:24:58.884836 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-effa83f7-1830-4d14-8f8b-79bd6e7768bb tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:24:58.885313 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-effa83f7-1830-4d14-8f8b-79bd6e7768bb tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:24:58.885744 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-effa83f7-1830-4d14-8f8b-79bd6e7768bb tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:24:58.886430 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-effa83f7-1830-4d14-8f8b-79bd6e7768bb tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:24:58.886875 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-effa83f7-1830-4d14-8f8b-79bd6e7768bb tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:24:58.887303 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-effa83f7-1830-4d14-8f8b-79bd6e7768bb tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:24:59.022859 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-effa83f7-1830-4d14-8f8b-79bd6e7768bb tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:24:59.031317 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-effa83f7-1830-4d14-8f8b-79bd6e7768bb tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/bca89234-9e28-499e-b408-3aa8576cd818" status: 200 len: 1453 microversion: 2.1 time: 0.157810 Aug 31 13:24:59.031966 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 563/1152] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:24:58 2022] GET /compute/v2.1/servers/bca89234-9e28-499e-b408-3aa8576cd818 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:25:00.754987 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-484e94a1-16fd-4d8f-8b8d-faab6c7931d6 req-f82dd240-1b32-4add-b291-5e5704044a93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bca89234-9e28-499e-b408-3aa8576cd818", "tag": "4ebcdce5-d076-425a-8235-89c452379b09"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:25:00.764605 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-484e94a1-16fd-4d8f-8b8d-faab6c7931d6 req-f82dd240-1b32-4add-b291-5e5704044a93 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:25:00.765070 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-484e94a1-16fd-4d8f-8b8d-faab6c7931d6 req-f82dd240-1b32-4add-b291-5e5704044a93 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:25:00.765482 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-484e94a1-16fd-4d8f-8b8d-faab6c7931d6 req-f82dd240-1b32-4add-b291-5e5704044a93 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:25:00.777359 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-484e94a1-16fd-4d8f-8b8d-faab6c7931d6 req-f82dd240-1b32-4add-b291-5e5704044a93 service nova] Creating event network-changed:4ebcdce5-d076-425a-8235-89c452379b09 for instance bca89234-9e28-499e-b408-3aa8576cd818 on hv-cinder-85442 Aug 31 13:25:00.782432 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-484e94a1-16fd-4d8f-8b8d-faab6c7931d6 req-f82dd240-1b32-4add-b291-5e5704044a93 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089977 Aug 31 13:25:00.783469 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 590/1153] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:27:29.254728 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:27:29.255485 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:27:29.256739 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 13:27:29.256911 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Wed Aug 31 13:27:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.58) !!! Aug 31 13:27:29.261531 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-5ad56c6c-103c-4a09-81f0-8b9b2cb9024a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-703147137", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-79203537", "security_groups": [{"name": "tempest-secgroup-smoke-1471111224"}], "block_device_mapping_v2": [{"uuid": "bce81272-b5ef-420c-8dd1-be9598fc64a9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c8f7a1ff-b0b8-4c3a-b081-57ae0e3ac414"}]}} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:27:29.390143 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.network.neutron [None req-5ad56c6c-103c-4a09-81f0-8b9b2cb9024a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] validate_networks() for [('c8f7a1ff-b0b8-4c3a-b081-57ae0e3ac414', None, None, None, None, None)] {{(pid=120705) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 13:27:29.837277 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-5ad56c6c-103c-4a09-81f0-8b9b2cb9024a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Flavor limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 13:27:29.837694 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-5ad56c6c-103c-4a09-81f0-8b9b2cb9024a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Image limits 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 13:27:29.838153 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-5ad56c6c-103c-4a09-81f0-8b9b2cb9024a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Flavor pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 13:27:29.838583 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-5ad56c6c-103c-4a09-81f0-8b9b2cb9024a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Image pref 0:0:0 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 13:27:29.839137 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.virt.hardware [None req-5ad56c6c-103c-4a09-81f0-8b9b2cb9024a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 13:27:29.848600 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5ad56c6c-103c-4a09-81f0-8b9b2cb9024a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:27:29.849107 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5ad56c6c-103c-4a09-81f0-8b9b2cb9024a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:27:29.849535 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5ad56c6c-103c-4a09-81f0-8b9b2cb9024a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:27:29.850230 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5ad56c6c-103c-4a09-81f0-8b9b2cb9024a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:27:29.850673 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5ad56c6c-103c-4a09-81f0-8b9b2cb9024a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:27:29.851090 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-5ad56c6c-103c-4a09-81f0-8b9b2cb9024a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:27:29.869057 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-5ad56c6c-103c-4a09-81f0-8b9b2cb9024a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Getting quotas for project b83394c784464c69843feac5ed7050dd. Resources: {'instances', 'ram', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 13:27:29.873596 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.quota [None req-5ad56c6c-103c-4a09-81f0-8b9b2cb9024a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Getting quotas for user e6897b60675a4c99a47ed51cdcbd1d39 and project b83394c784464c69843feac5ed7050dd. Resources: {'instances', 'ram', 'cores'} {{(pid=120705) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 13:27:29.935850 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-5ad56c6c-103c-4a09-81f0-8b9b2cb9024a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Going to run 1 instances... {{(pid=120705) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 13:27:29.938147 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-5ad56c6c-103c-4a09-81f0-8b9b2cb9024a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: 03c69bbd-ab41-4734-bf59-1160664f6188] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bce81272-b5ef-420c-8dd1-be9598fc64a9',volume_size=None,volume_type=None)] {{(pid=120705) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 13:27:30.079728 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-5ad56c6c-103c-4a09-81f0-8b9b2cb9024a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.826831 Aug 31 13:27:30.080515 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 564/1154] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 31 13:27:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 13:27:30.089709 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR oslo.messaging._drivers.impl_rabbit [-] [21e1c21b-e7d8-4756-bb91-56a53e58253d] AMQP server on 10.222.0.58:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 31 13:27:30.090938 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:27:30.091853 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell1:SELECT=66 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:27:30.097289 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-0af179d9-bcf7-4a2a-a93a-7f33a374c1a0 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:27:30.097995 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-0af179d9-bcf7-4a2a-a93a-7f33a374c1a0 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: 03c69bbd-ab41-4734-bf59-1160664f6188] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:27:30.154353 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-0af179d9-bcf7-4a2a-a93a-7f33a374c1a0 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:27:30.162109 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-0af179d9-bcf7-4a2a-a93a-7f33a374c1a0 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188" status: 200 len: 1092 microversion: 2.1 time: 0.074407 Aug 31 13:27:30.162685 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 591/1155] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:27:30 2022] GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188 => generated 1092 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:27:31.182558 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-2e0d0e8b-49a3-4499-8c0c-371c7e087961 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:27:31.183160 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-2e0d0e8b-49a3-4499-8c0c-371c7e087961 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: 03c69bbd-ab41-4734-bf59-1160664f6188] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:27:31.235524 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-2e0d0e8b-49a3-4499-8c0c-371c7e087961 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:27:31.242895 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-2e0d0e8b-49a3-4499-8c0c-371c7e087961 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188" status: 200 len: 1092 microversion: 2.1 time: 0.064879 Aug 31 13:27:31.243474 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 565/1156] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:27:31 2022] GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188 => generated 1092 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:27:32.265806 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-89e727c1-bb41-46bf-a69c-902b437c4718 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:27:32.266517 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-89e727c1-bb41-46bf-a69c-902b437c4718 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: 03c69bbd-ab41-4734-bf59-1160664f6188] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:27:32.277405 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-89e727c1-bb41-46bf-a69c-902b437c4718 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:27:32.277992 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-89e727c1-bb41-46bf-a69c-902b437c4718 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:27:32.278523 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-89e727c1-bb41-46bf-a69c-902b437c4718 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:27:32.279363 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-89e727c1-bb41-46bf-a69c-902b437c4718 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:27:32.280179 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-89e727c1-bb41-46bf-a69c-902b437c4718 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:27:32.280699 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-89e727c1-bb41-46bf-a69c-902b437c4718 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:27:32.288231 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO oslo.messaging._drivers.impl_rabbit [-] [21e1c21b-e7d8-4756-bb91-56a53e58253d] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 47338. Aug 31 13:27:32.358179 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-89e727c1-bb41-46bf-a69c-902b437c4718 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:27:32.366116 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-89e727c1-bb41-46bf-a69c-902b437c4718 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188" status: 200 len: 1142 microversion: 2.1 time: 0.105660 Aug 31 13:27:32.366695 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 592/1157] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:27:32 2022] GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188 => generated 1142 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:27:33.388703 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-efea6f9d-7cf1-4346-9774-9de78f4b969b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:27:33.389719 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-efea6f9d-7cf1-4346-9774-9de78f4b969b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: 03c69bbd-ab41-4734-bf59-1160664f6188] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:27:33.400931 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-efea6f9d-7cf1-4346-9774-9de78f4b969b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:27:33.401439 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-efea6f9d-7cf1-4346-9774-9de78f4b969b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:27:33.401877 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-efea6f9d-7cf1-4346-9774-9de78f4b969b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:27:33.402778 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-efea6f9d-7cf1-4346-9774-9de78f4b969b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:27:33.403213 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-efea6f9d-7cf1-4346-9774-9de78f4b969b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:27:33.403633 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-efea6f9d-7cf1-4346-9774-9de78f4b969b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:27:33.474347 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-efea6f9d-7cf1-4346-9774-9de78f4b969b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:27:33.484763 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-efea6f9d-7cf1-4346-9774-9de78f4b969b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188" status: 200 len: 1198 microversion: 2.1 time: 0.101567 Aug 31 13:27:33.485562 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 566/1158] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:27:33 2022] GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188 => generated 1198 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:27:34.505606 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-b9f1fafd-4394-4e44-a3d1-08e65af31c38 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:27:34.506244 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-b9f1fafd-4394-4e44-a3d1-08e65af31c38 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: 03c69bbd-ab41-4734-bf59-1160664f6188] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:27:34.512675 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b9f1fafd-4394-4e44-a3d1-08e65af31c38 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:27:34.513177 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b9f1fafd-4394-4e44-a3d1-08e65af31c38 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:27:34.513587 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b9f1fafd-4394-4e44-a3d1-08e65af31c38 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:27:34.514281 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b9f1fafd-4394-4e44-a3d1-08e65af31c38 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:27:34.514729 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b9f1fafd-4394-4e44-a3d1-08e65af31c38 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:27:34.515149 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-b9f1fafd-4394-4e44-a3d1-08e65af31c38 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:27:34.652183 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-b9f1fafd-4394-4e44-a3d1-08e65af31c38 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:27:34.660488 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-b9f1fafd-4394-4e44-a3d1-08e65af31c38 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188" status: 200 len: 1264 microversion: 2.1 time: 0.158774 Aug 31 13:27:34.661080 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 593/1159] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:27:34 2022] GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:27:34.920678 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-344c3c72-8e3c-49fc-b9a3-132f6e533e85 req-f1287271-86de-411d-aac5-6a0d6d83dab4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03c69bbd-ab41-4734-bf59-1160664f6188", "tag": "d849dca9-27d1-48a4-bd31-c8ca770de685"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:27:34.931549 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-344c3c72-8e3c-49fc-b9a3-132f6e533e85 req-f1287271-86de-411d-aac5-6a0d6d83dab4 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:27:34.932146 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-344c3c72-8e3c-49fc-b9a3-132f6e533e85 req-f1287271-86de-411d-aac5-6a0d6d83dab4 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:27:34.932645 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-344c3c72-8e3c-49fc-b9a3-132f6e533e85 req-f1287271-86de-411d-aac5-6a0d6d83dab4 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:27:34.949400 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-344c3c72-8e3c-49fc-b9a3-132f6e533e85 req-f1287271-86de-411d-aac5-6a0d6d83dab4 service nova] Creating event network-changed:d849dca9-27d1-48a4-bd31-c8ca770de685 for instance 03c69bbd-ab41-4734-bf59-1160664f6188 on hv-cinder-85442 Aug 31 13:27:34.954734 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-344c3c72-8e3c-49fc-b9a3-132f6e533e85 req-f1287271-86de-411d-aac5-6a0d6d83dab4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107688 Aug 31 13:27:34.955630 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 567/1160] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:27:35.684405 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-cbed9ddc-a2e2-4bb4-b27f-dd941ed0305b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:27:35.685267 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-cbed9ddc-a2e2-4bb4-b27f-dd941ed0305b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: 03c69bbd-ab41-4734-bf59-1160664f6188] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:27:35.694655 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cbed9ddc-a2e2-4bb4-b27f-dd941ed0305b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:27:35.695322 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cbed9ddc-a2e2-4bb4-b27f-dd941ed0305b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:27:35.695969 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cbed9ddc-a2e2-4bb4-b27f-dd941ed0305b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:27:35.696943 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cbed9ddc-a2e2-4bb4-b27f-dd941ed0305b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:27:35.697572 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cbed9ddc-a2e2-4bb4-b27f-dd941ed0305b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:27:35.698159 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-cbed9ddc-a2e2-4bb4-b27f-dd941ed0305b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:27:35.834603 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-cbed9ddc-a2e2-4bb4-b27f-dd941ed0305b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:27:35.842551 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-cbed9ddc-a2e2-4bb4-b27f-dd941ed0305b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188" status: 200 len: 1264 microversion: 2.1 time: 0.163648 Aug 31 13:27:35.843130 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 594/1161] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:27:35 2022] GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:27:36.864797 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-4b198429-8943-414e-8b6e-30415ba3f970 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:27:36.865493 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-4b198429-8943-414e-8b6e-30415ba3f970 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: 03c69bbd-ab41-4734-bf59-1160664f6188] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:27:36.872214 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4b198429-8943-414e-8b6e-30415ba3f970 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:27:36.872689 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4b198429-8943-414e-8b6e-30415ba3f970 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:27:36.873119 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4b198429-8943-414e-8b6e-30415ba3f970 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:27:36.873810 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4b198429-8943-414e-8b6e-30415ba3f970 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:27:36.874267 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4b198429-8943-414e-8b6e-30415ba3f970 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:27:36.874772 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-4b198429-8943-414e-8b6e-30415ba3f970 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:27:37.022020 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-4b198429-8943-414e-8b6e-30415ba3f970 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:27:37.030732 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-4b198429-8943-414e-8b6e-30415ba3f970 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188" status: 200 len: 1264 microversion: 2.1 time: 0.170676 Aug 31 13:27:37.031493 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 568/1162] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:27:36 2022] GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:27:38.055956 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-27406a03-8f6b-4b42-ab8d-e03883303f5e tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:27:38.056867 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-27406a03-8f6b-4b42-ab8d-e03883303f5e tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: 03c69bbd-ab41-4734-bf59-1160664f6188] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:27:38.067689 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-27406a03-8f6b-4b42-ab8d-e03883303f5e tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:27:38.068535 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-27406a03-8f6b-4b42-ab8d-e03883303f5e tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:27:38.069250 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-27406a03-8f6b-4b42-ab8d-e03883303f5e tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:27:38.070370 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-27406a03-8f6b-4b42-ab8d-e03883303f5e tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:27:38.071102 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-27406a03-8f6b-4b42-ab8d-e03883303f5e tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:27:38.071793 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-27406a03-8f6b-4b42-ab8d-e03883303f5e tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:27:38.204125 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-27406a03-8f6b-4b42-ab8d-e03883303f5e tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:27:38.216096 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-27406a03-8f6b-4b42-ab8d-e03883303f5e tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188" status: 200 len: 1264 microversion: 2.1 time: 0.166322 Aug 31 13:27:38.216873 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 595/1163] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:27:38 2022] GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:27:39.247539 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-798eccc8-c527-4dee-a0d8-c16a696d9bee tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:27:39.248526 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-798eccc8-c527-4dee-a0d8-c16a696d9bee tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: 03c69bbd-ab41-4734-bf59-1160664f6188] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:27:39.255610 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-798eccc8-c527-4dee-a0d8-c16a696d9bee tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:27:39.256128 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-798eccc8-c527-4dee-a0d8-c16a696d9bee tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:27:39.256571 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-798eccc8-c527-4dee-a0d8-c16a696d9bee tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:27:39.257266 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-798eccc8-c527-4dee-a0d8-c16a696d9bee tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:27:39.257715 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-798eccc8-c527-4dee-a0d8-c16a696d9bee tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:27:39.258139 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-798eccc8-c527-4dee-a0d8-c16a696d9bee tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:27:39.393597 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-798eccc8-c527-4dee-a0d8-c16a696d9bee tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:27:39.401839 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-798eccc8-c527-4dee-a0d8-c16a696d9bee tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188" status: 200 len: 1264 microversion: 2.1 time: 0.161049 Aug 31 13:27:39.402454 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 569/1164] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:27:39 2022] GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:27:40.425956 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-37fb5802-63eb-49ce-8e89-0ec6a54e25d9 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:27:40.426664 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-37fb5802-63eb-49ce-8e89-0ec6a54e25d9 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: 03c69bbd-ab41-4734-bf59-1160664f6188] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:27:40.429371 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell0:SELECT=2 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:27:40.435937 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-37fb5802-63eb-49ce-8e89-0ec6a54e25d9 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:27:40.436500 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-37fb5802-63eb-49ce-8e89-0ec6a54e25d9 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:27:40.437018 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-37fb5802-63eb-49ce-8e89-0ec6a54e25d9 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:27:40.437802 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-37fb5802-63eb-49ce-8e89-0ec6a54e25d9 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:27:40.438323 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-37fb5802-63eb-49ce-8e89-0ec6a54e25d9 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:27:40.438816 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-37fb5802-63eb-49ce-8e89-0ec6a54e25d9 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:27:40.583562 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-37fb5802-63eb-49ce-8e89-0ec6a54e25d9 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:27:40.591713 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-37fb5802-63eb-49ce-8e89-0ec6a54e25d9 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188" status: 200 len: 1264 microversion: 2.1 time: 0.170993 Aug 31 13:27:40.592335 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 596/1165] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:27:40 2022] GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188 => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:27:41.613126 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3ce9526d-6a99-47df-884a-e69a70e4af9b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:27:41.613702 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-3ce9526d-6a99-47df-884a-e69a70e4af9b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: 03c69bbd-ab41-4734-bf59-1160664f6188] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:27:41.615692 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=2 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:27:41.616854 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell0:SELECT=8 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:27:41.622772 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3ce9526d-6a99-47df-884a-e69a70e4af9b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:27:41.623248 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3ce9526d-6a99-47df-884a-e69a70e4af9b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:27:41.623676 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3ce9526d-6a99-47df-884a-e69a70e4af9b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:27:41.624389 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3ce9526d-6a99-47df-884a-e69a70e4af9b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:27:41.624848 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3ce9526d-6a99-47df-884a-e69a70e4af9b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:27:41.625273 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3ce9526d-6a99-47df-884a-e69a70e4af9b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:27:41.777444 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-3ce9526d-6a99-47df-884a-e69a70e4af9b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:27:41.785749 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-3ce9526d-6a99-47df-884a-e69a70e4af9b tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188" status: 200 len: 1264 microversion: 2.1 time: 0.176661 Aug 31 13:27:41.786294 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 570/1166] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:27:41 2022] GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188 => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:27:42.811193 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-89ff476f-ce2c-4a8f-9982-ca0d3b08977a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:27:42.812408 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-89ff476f-ce2c-4a8f-9982-ca0d3b08977a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: 03c69bbd-ab41-4734-bf59-1160664f6188] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:27:42.819305 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-89ff476f-ce2c-4a8f-9982-ca0d3b08977a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:27:42.819775 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-89ff476f-ce2c-4a8f-9982-ca0d3b08977a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:27:42.820223 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-89ff476f-ce2c-4a8f-9982-ca0d3b08977a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:27:42.820900 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-89ff476f-ce2c-4a8f-9982-ca0d3b08977a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:27:42.821340 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-89ff476f-ce2c-4a8f-9982-ca0d3b08977a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:27:42.821752 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-89ff476f-ce2c-4a8f-9982-ca0d3b08977a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:27:42.958554 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-89ff476f-ce2c-4a8f-9982-ca0d3b08977a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:27:42.969721 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-89ff476f-ce2c-4a8f-9982-ca0d3b08977a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188" status: 200 len: 1264 microversion: 2.1 time: 0.165017 Aug 31 13:27:42.970274 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 597/1167] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:27:42 2022] GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:27:43.994733 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-2dd0027a-56d1-411d-b9d5-d6c200b00024 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:27:43.995712 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-2dd0027a-56d1-411d-b9d5-d6c200b00024 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: 03c69bbd-ab41-4734-bf59-1160664f6188] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:27:44.006975 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2dd0027a-56d1-411d-b9d5-d6c200b00024 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:27:44.007761 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2dd0027a-56d1-411d-b9d5-d6c200b00024 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:27:44.008524 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2dd0027a-56d1-411d-b9d5-d6c200b00024 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:27:44.009638 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2dd0027a-56d1-411d-b9d5-d6c200b00024 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:27:44.010374 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2dd0027a-56d1-411d-b9d5-d6c200b00024 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:27:44.011062 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-2dd0027a-56d1-411d-b9d5-d6c200b00024 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:27:44.157564 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-2dd0027a-56d1-411d-b9d5-d6c200b00024 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:27:44.165836 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-2dd0027a-56d1-411d-b9d5-d6c200b00024 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188" status: 200 len: 1264 microversion: 2.1 time: 0.177760 Aug 31 13:27:44.166439 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 571/1168] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:27:43 2022] GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188 => generated 1264 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:27:45.190312 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-ac1022b0-b451-4ae1-a12a-a53b14d64f2d tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:27:45.191149 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-ac1022b0-b451-4ae1-a12a-a53b14d64f2d tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: 03c69bbd-ab41-4734-bf59-1160664f6188] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:27:45.200114 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ac1022b0-b451-4ae1-a12a-a53b14d64f2d tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:27:45.200739 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ac1022b0-b451-4ae1-a12a-a53b14d64f2d tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:27:45.201314 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ac1022b0-b451-4ae1-a12a-a53b14d64f2d tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:27:45.202359 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ac1022b0-b451-4ae1-a12a-a53b14d64f2d tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:27:45.202943 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ac1022b0-b451-4ae1-a12a-a53b14d64f2d tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:27:45.203490 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-ac1022b0-b451-4ae1-a12a-a53b14d64f2d tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:27:45.349366 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-ac1022b0-b451-4ae1-a12a-a53b14d64f2d tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:27:45.361584 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-ac1022b0-b451-4ae1-a12a-a53b14d64f2d tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188" status: 200 len: 1264 microversion: 2.1 time: 0.177022 Aug 31 13:27:45.362407 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 598/1169] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:27:45 2022] GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188 => generated 1264 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:27:46.392011 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-6f14b3d9-a3b6-4a15-914f-307814e453ff tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:27:46.392895 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-6f14b3d9-a3b6-4a15-914f-307814e453ff tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: 03c69bbd-ab41-4734-bf59-1160664f6188] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:27:46.404225 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6f14b3d9-a3b6-4a15-914f-307814e453ff tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:27:46.405012 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6f14b3d9-a3b6-4a15-914f-307814e453ff tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:27:46.405729 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6f14b3d9-a3b6-4a15-914f-307814e453ff tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:27:46.406952 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6f14b3d9-a3b6-4a15-914f-307814e453ff tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:27:46.407693 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6f14b3d9-a3b6-4a15-914f-307814e453ff tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:27:46.408437 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-6f14b3d9-a3b6-4a15-914f-307814e453ff tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:27:46.557220 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-6f14b3d9-a3b6-4a15-914f-307814e453ff tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:27:46.566594 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-6f14b3d9-a3b6-4a15-914f-307814e453ff tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188" status: 200 len: 1264 microversion: 2.1 time: 0.181451 Aug 31 13:27:46.567176 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 572/1170] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:27:46 2022] GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188 => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:27:46.902977 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-c9c67cad-284b-4770-bd81-75a461e1e9af req-0bf36533-86ef-4af9-a424-21a60c807e21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03c69bbd-ab41-4734-bf59-1160664f6188", "name": "network-vif-plugged", "status": "completed", "tag": "d849dca9-27d1-48a4-bd31-c8ca770de685"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:27:46.913334 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-c9c67cad-284b-4770-bd81-75a461e1e9af req-0bf36533-86ef-4af9-a424-21a60c807e21 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:27:46.913802 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-c9c67cad-284b-4770-bd81-75a461e1e9af req-0bf36533-86ef-4af9-a424-21a60c807e21 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:27:46.914230 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-c9c67cad-284b-4770-bd81-75a461e1e9af req-0bf36533-86ef-4af9-a424-21a60c807e21 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:27:46.925959 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-c9c67cad-284b-4770-bd81-75a461e1e9af req-0bf36533-86ef-4af9-a424-21a60c807e21 service nova] Creating event network-vif-plugged:d849dca9-27d1-48a4-bd31-c8ca770de685 for instance 03c69bbd-ab41-4734-bf59-1160664f6188 on hv-cinder-85442 Aug 31 13:27:46.929382 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR oslo.messaging._drivers.impl_rabbit [req-c9c67cad-284b-4770-bd81-75a461e1e9af req-0bf36533-86ef-4af9-a424-21a60c807e21 service nova] [2cc6d3a1-bacc-42a0-a175-9e001b09ec89] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 13:27:47.591399 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-bcd8f428-3749-487d-a4c3-8e222986f065 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:27:47.592504 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-bcd8f428-3749-487d-a4c3-8e222986f065 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: 03c69bbd-ab41-4734-bf59-1160664f6188] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:27:47.599800 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bcd8f428-3749-487d-a4c3-8e222986f065 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:27:47.600334 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bcd8f428-3749-487d-a4c3-8e222986f065 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:27:47.600758 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bcd8f428-3749-487d-a4c3-8e222986f065 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:27:47.601445 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bcd8f428-3749-487d-a4c3-8e222986f065 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:27:47.601887 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bcd8f428-3749-487d-a4c3-8e222986f065 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:27:47.602300 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-bcd8f428-3749-487d-a4c3-8e222986f065 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:27:47.744525 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-bcd8f428-3749-487d-a4c3-8e222986f065 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:27:47.755978 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-bcd8f428-3749-487d-a4c3-8e222986f065 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188" status: 200 len: 1264 microversion: 2.1 time: 0.171020 Aug 31 13:27:47.756752 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 573/1171] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:27:47 2022] GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188 => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:27:47.940692 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO oslo.messaging._drivers.impl_rabbit [req-c9c67cad-284b-4770-bd81-75a461e1e9af req-0bf36533-86ef-4af9-a424-21a60c807e21 service nova] [2cc6d3a1-bacc-42a0-a175-9e001b09ec89] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 47382. Aug 31 13:27:47.948710 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-c9c67cad-284b-4770-bd81-75a461e1e9af req-0bf36533-86ef-4af9-a424-21a60c807e21 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.049320 Aug 31 13:27:47.950081 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 599/1172] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:27:48.781219 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-3e8c0405-995a-4451-850c-d6a9a27e0cde tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:27:48.782183 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-3e8c0405-995a-4451-850c-d6a9a27e0cde tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: 03c69bbd-ab41-4734-bf59-1160664f6188] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:27:48.793297 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3e8c0405-995a-4451-850c-d6a9a27e0cde tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:27:48.794092 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3e8c0405-995a-4451-850c-d6a9a27e0cde tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:27:48.794819 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3e8c0405-995a-4451-850c-d6a9a27e0cde tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:27:48.796011 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3e8c0405-995a-4451-850c-d6a9a27e0cde tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:27:48.796811 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3e8c0405-995a-4451-850c-d6a9a27e0cde tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:27:48.797232 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-3e8c0405-995a-4451-850c-d6a9a27e0cde tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:27:48.942868 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-3e8c0405-995a-4451-850c-d6a9a27e0cde tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:27:48.951183 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-3e8c0405-995a-4451-850c-d6a9a27e0cde tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188" status: 200 len: 1264 microversion: 2.1 time: 0.176657 Aug 31 13:27:48.951738 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 574/1173] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:27:48 2022] GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188 => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:27:49.974794 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-9696435c-f215-4e4c-90a9-cdc1bab863d5 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:27:49.975488 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-9696435c-f215-4e4c-90a9-cdc1bab863d5 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: 03c69bbd-ab41-4734-bf59-1160664f6188] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:27:49.982392 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9696435c-f215-4e4c-90a9-cdc1bab863d5 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:27:49.982870 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9696435c-f215-4e4c-90a9-cdc1bab863d5 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:27:49.983292 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9696435c-f215-4e4c-90a9-cdc1bab863d5 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:27:49.984077 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9696435c-f215-4e4c-90a9-cdc1bab863d5 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:27:49.984511 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9696435c-f215-4e4c-90a9-cdc1bab863d5 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:27:49.984944 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9696435c-f215-4e4c-90a9-cdc1bab863d5 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:27:50.127240 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-9696435c-f215-4e4c-90a9-cdc1bab863d5 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:27:50.135063 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-9696435c-f215-4e4c-90a9-cdc1bab863d5 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188" status: 200 len: 1264 microversion: 2.1 time: 0.165174 Aug 31 13:27:50.135644 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 600/1174] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:27:49 2022] GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:27:51.159606 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-1570f2b4-7bd9-42bc-ad4a-b610c275331f tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:27:51.160395 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-1570f2b4-7bd9-42bc-ad4a-b610c275331f tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: 03c69bbd-ab41-4734-bf59-1160664f6188] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:27:51.169035 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1570f2b4-7bd9-42bc-ad4a-b610c275331f tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:27:51.169641 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1570f2b4-7bd9-42bc-ad4a-b610c275331f tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:27:51.170175 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1570f2b4-7bd9-42bc-ad4a-b610c275331f tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:27:51.171032 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1570f2b4-7bd9-42bc-ad4a-b610c275331f tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:27:51.171599 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1570f2b4-7bd9-42bc-ad4a-b610c275331f tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:27:51.172168 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-1570f2b4-7bd9-42bc-ad4a-b610c275331f tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:27:51.325250 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-1570f2b4-7bd9-42bc-ad4a-b610c275331f tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:27:51.336787 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-1570f2b4-7bd9-42bc-ad4a-b610c275331f tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188" status: 200 len: 1451 microversion: 2.1 time: 0.182524 Aug 31 13:27:51.337576 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 575/1175] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:27:51 2022] GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188 => generated 1451 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:27:51.358718 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-bb374fe5-c6e9-4136-b487-6e21ae10d85a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:27:51.359498 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-bb374fe5-c6e9-4136-b487-6e21ae10d85a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: 03c69bbd-ab41-4734-bf59-1160664f6188] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:27:51.366296 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bb374fe5-c6e9-4136-b487-6e21ae10d85a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:27:51.366771 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bb374fe5-c6e9-4136-b487-6e21ae10d85a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:27:51.367200 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bb374fe5-c6e9-4136-b487-6e21ae10d85a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:27:51.367913 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bb374fe5-c6e9-4136-b487-6e21ae10d85a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:27:51.368355 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bb374fe5-c6e9-4136-b487-6e21ae10d85a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:27:51.368774 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-bb374fe5-c6e9-4136-b487-6e21ae10d85a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:27:51.500063 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-bb374fe5-c6e9-4136-b487-6e21ae10d85a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:27:51.508028 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-bb374fe5-c6e9-4136-b487-6e21ae10d85a tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188" status: 200 len: 1451 microversion: 2.1 time: 0.153159 Aug 31 13:27:51.508616 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 601/1176] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:27:51 2022] GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:27:53.488038 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-baf97efd-572a-4d09-86f7-ad12ad10bad3 req-9207e574-15cc-4208-b52b-5b0f7891c674 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03c69bbd-ab41-4734-bf59-1160664f6188", "tag": "d849dca9-27d1-48a4-bd31-c8ca770de685"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:27:53.497759 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-baf97efd-572a-4d09-86f7-ad12ad10bad3 req-9207e574-15cc-4208-b52b-5b0f7891c674 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:27:53.498223 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-baf97efd-572a-4d09-86f7-ad12ad10bad3 req-9207e574-15cc-4208-b52b-5b0f7891c674 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:27:53.498642 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-baf97efd-572a-4d09-86f7-ad12ad10bad3 req-9207e574-15cc-4208-b52b-5b0f7891c674 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:27:53.509822 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-baf97efd-572a-4d09-86f7-ad12ad10bad3 req-9207e574-15cc-4208-b52b-5b0f7891c674 service nova] Creating event network-changed:d849dca9-27d1-48a4-bd31-c8ca770de685 for instance 03c69bbd-ab41-4734-bf59-1160664f6188 on hv-cinder-85442 Aug 31 13:27:53.514956 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-baf97efd-572a-4d09-86f7-ad12ad10bad3 req-9207e574-15cc-4208-b52b-5b0f7891c674 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031194 Aug 31 13:27:53.515792 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 576/1177] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:29:54.292672 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f9685a4a-455a-4764-a389-1722cce5526b] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 13:29:54.293357 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:29:54.293968 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG dbcounter [-] [120705] Writing DB stats nova_cell1:SELECT=60 {{(pid=120705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:29:54.294350 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-8f5c8c0e-6d87-41ef-b82f-392beb9b31fb tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:29:54.294982 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 13:29:54.295120 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Wed Aug 31 13:29:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.58) !!! Aug 31 13:29:54.296938 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-8f5c8c0e-6d87-41ef-b82f-392beb9b31fb tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: 03c69bbd-ab41-4734-bf59-1160664f6188] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:29:54.301706 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [req-0c97ea57-a4c9-4e7b-8790-02210f1c0cbc req-4fad3fda-503b-488b-a13f-7bca4197da2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03c69bbd-ab41-4734-bf59-1160664f6188", "tag": "d849dca9-27d1-48a4-bd31-c8ca770de685"}]} {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:29:54.304432 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_api:SELECT=24 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:29:54.305887 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG dbcounter [-] [120704] Writing DB stats nova_cell1:SELECT=56 {{(pid=120704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:29:54.307433 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 13:29:54.307657 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Wed Aug 31 13:29:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188 (ip 10.222.0.58) !!! Aug 31 13:29:54.311245 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 13:29:54.311441 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Wed Aug 31 13:29:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188 (ip 10.222.0.58) !!! Aug 31 13:29:54.313404 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-0c97ea57-a4c9-4e7b-8790-02210f1c0cbc req-4fad3fda-503b-488b-a13f-7bca4197da2b service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:29:54.314093 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-0c97ea57-a4c9-4e7b-8790-02210f1c0cbc req-4fad3fda-503b-488b-a13f-7bca4197da2b service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:29:54.314754 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [req-0c97ea57-a4c9-4e7b-8790-02210f1c0cbc req-4fad3fda-503b-488b-a13f-7bca4197da2b service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:29:54.327768 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.compute.server_external_events [req-0c97ea57-a4c9-4e7b-8790-02210f1c0cbc req-4fad3fda-503b-488b-a13f-7bca4197da2b service nova] Creating event network-changed:d849dca9-27d1-48a4-bd31-c8ca770de685 for instance 03c69bbd-ab41-4734-bf59-1160664f6188 on hv-cinder-85442 Aug 31 13:29:54.332810 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [req-0c97ea57-a4c9-4e7b-8790-02210f1c0cbc req-4fad3fda-503b-488b-a13f-7bca4197da2b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041770 Aug 31 13:29:54.333413 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 577/1178] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:29:54.338184 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8f5c8c0e-6d87-41ef-b82f-392beb9b31fb tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:29:54.338806 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8f5c8c0e-6d87-41ef-b82f-392beb9b31fb tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:29:54.339528 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8f5c8c0e-6d87-41ef-b82f-392beb9b31fb tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:29:54.340597 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8f5c8c0e-6d87-41ef-b82f-392beb9b31fb tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:29:54.341202 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8f5c8c0e-6d87-41ef-b82f-392beb9b31fb tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:29:54.341674 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-8f5c8c0e-6d87-41ef-b82f-392beb9b31fb tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:29:54.375462 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-8f5c8c0e-6d87-41ef-b82f-392beb9b31fb tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: 03c69bbd-ab41-4734-bf59-1160664f6188] Going to try to terminate instance {{(pid=120704) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 13:29:54.472486 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-8f5c8c0e-6d87-41ef-b82f-392beb9b31fb tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "DELETE /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188" status: 204 len: 0 microversion: 2.1 time: 0.183049 Aug 31 13:29:54.473391 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 602/1179] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 31 13:29:54 2022] DELETE /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:29:54.482362 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-aeafe6ac-d057-40f6-81bc-d27591116be6 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:29:54.483029 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-aeafe6ac-d057-40f6-81bc-d27591116be6 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: 03c69bbd-ab41-4734-bf59-1160664f6188] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:29:54.492206 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-aeafe6ac-d057-40f6-81bc-d27591116be6 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:29:54.492781 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-aeafe6ac-d057-40f6-81bc-d27591116be6 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:29:54.493282 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-aeafe6ac-d057-40f6-81bc-d27591116be6 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:29:54.494129 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-aeafe6ac-d057-40f6-81bc-d27591116be6 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:29:54.494674 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-aeafe6ac-d057-40f6-81bc-d27591116be6 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:29:54.495643 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-aeafe6ac-d057-40f6-81bc-d27591116be6 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:29:54.718507 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-aeafe6ac-d057-40f6-81bc-d27591116be6 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:29:54.726821 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-aeafe6ac-d057-40f6-81bc-d27591116be6 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188" status: 200 len: 1576 microversion: 2.1 time: 0.248887 Aug 31 13:29:54.727421 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 578/1180] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:29:54 2022] GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188 => generated 1576 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:29:55.757246 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-d866bd6b-ea2f-48ba-ae3d-a9a058292adf tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:29:55.757246 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-d866bd6b-ea2f-48ba-ae3d-a9a058292adf tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: 03c69bbd-ab41-4734-bf59-1160664f6188] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:29:55.768324 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d866bd6b-ea2f-48ba-ae3d-a9a058292adf tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:29:55.768892 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d866bd6b-ea2f-48ba-ae3d-a9a058292adf tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:29:55.769598 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d866bd6b-ea2f-48ba-ae3d-a9a058292adf tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:29:55.771211 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d866bd6b-ea2f-48ba-ae3d-a9a058292adf tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:29:55.771948 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d866bd6b-ea2f-48ba-ae3d-a9a058292adf tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:29:55.772670 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-d866bd6b-ea2f-48ba-ae3d-a9a058292adf tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:29:55.956012 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-d866bd6b-ea2f-48ba-ae3d-a9a058292adf tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:29:55.964618 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-d866bd6b-ea2f-48ba-ae3d-a9a058292adf tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188" status: 200 len: 1576 microversion: 2.1 time: 0.216864 Aug 31 13:29:55.965208 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 603/1181] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:29:55 2022] GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188 => generated 1576 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:29:56.986188 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-31689494-2486-4279-a294-d3289525d9ca tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:29:56.986763 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-31689494-2486-4279-a294-d3289525d9ca tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: 03c69bbd-ab41-4734-bf59-1160664f6188] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:29:56.996479 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-31689494-2486-4279-a294-d3289525d9ca tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:29:56.996950 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-31689494-2486-4279-a294-d3289525d9ca tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:29:56.997391 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-31689494-2486-4279-a294-d3289525d9ca tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:29:56.998089 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-31689494-2486-4279-a294-d3289525d9ca tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:29:56.998534 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-31689494-2486-4279-a294-d3289525d9ca tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:29:56.998953 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-31689494-2486-4279-a294-d3289525d9ca tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:29:57.006085 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO oslo.messaging._drivers.impl_rabbit [-] [f9685a4a-455a-4764-a389-1722cce5526b] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 47452. Aug 31 13:29:57.148886 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-31689494-2486-4279-a294-d3289525d9ca tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:29:57.157093 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-31689494-2486-4279-a294-d3289525d9ca tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188" status: 200 len: 1457 microversion: 2.1 time: 0.174838 Aug 31 13:29:57.157794 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 579/1182] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:29:56 2022] GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188 => generated 1457 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:29:57.184112 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-2995c5ce-81b7-45f4-abf9-041ffc43a930 req-1590046d-f0b0-42ae-98f6-c04402b5b194 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03c69bbd-ab41-4734-bf59-1160664f6188", "name": "network-vif-deleted", "tag": "d849dca9-27d1-48a4-bd31-c8ca770de685"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:29:57.194721 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-2995c5ce-81b7-45f4-abf9-041ffc43a930 req-1590046d-f0b0-42ae-98f6-c04402b5b194 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:29:57.195251 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-2995c5ce-81b7-45f4-abf9-041ffc43a930 req-1590046d-f0b0-42ae-98f6-c04402b5b194 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:29:57.195663 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-2995c5ce-81b7-45f4-abf9-041ffc43a930 req-1590046d-f0b0-42ae-98f6-c04402b5b194 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:29:57.207018 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-2995c5ce-81b7-45f4-abf9-041ffc43a930 req-1590046d-f0b0-42ae-98f6-c04402b5b194 service nova] Creating event network-vif-deleted:d849dca9-27d1-48a4-bd31-c8ca770de685 for instance 03c69bbd-ab41-4734-bf59-1160664f6188 on hv-cinder-85442 Aug 31 13:29:57.212128 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-2995c5ce-81b7-45f4-abf9-041ffc43a930 req-1590046d-f0b0-42ae-98f6-c04402b5b194 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031785 Aug 31 13:29:57.212729 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 604/1183] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:29:58.182943 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-db23e679-2376-4f15-bd3e-94b81be79c71 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:29:58.184364 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-db23e679-2376-4f15-bd3e-94b81be79c71 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: 03c69bbd-ab41-4734-bf59-1160664f6188] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:29:58.194163 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-db23e679-2376-4f15-bd3e-94b81be79c71 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:29:58.194643 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-db23e679-2376-4f15-bd3e-94b81be79c71 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:29:58.195123 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-db23e679-2376-4f15-bd3e-94b81be79c71 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:29:58.196484 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-db23e679-2376-4f15-bd3e-94b81be79c71 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:29:58.197168 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-db23e679-2376-4f15-bd3e-94b81be79c71 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:29:58.197793 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-db23e679-2376-4f15-bd3e-94b81be79c71 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:29:58.236705 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-db23e679-2376-4f15-bd3e-94b81be79c71 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:29:58.237181 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-db23e679-2376-4f15-bd3e-94b81be79c71 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:29:58.237593 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-db23e679-2376-4f15-bd3e-94b81be79c71 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:29:58.238043 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.objects.instance [None req-db23e679-2376-4f15-bd3e-94b81be79c71 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lazy-loading 'fault' on Instance uuid 03c69bbd-ab41-4734-bf59-1160664f6188 {{(pid=120705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 13:29:58.281625 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-db23e679-2376-4f15-bd3e-94b81be79c71 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:29:58.290410 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-db23e679-2376-4f15-bd3e-94b81be79c71 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188" status: 200 len: 1228 microversion: 2.1 time: 0.114087 Aug 31 13:29:58.290996 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 580/1184] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:29:58 2022] GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188 => generated 1228 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:29:59.317250 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-9c7a8088-7c9a-4bd2-8e06-fab2d12a66d7 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:29:59.318378 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-9c7a8088-7c9a-4bd2-8e06-fab2d12a66d7 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: 03c69bbd-ab41-4734-bf59-1160664f6188] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:29:59.326151 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9c7a8088-7c9a-4bd2-8e06-fab2d12a66d7 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:29:59.327000 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9c7a8088-7c9a-4bd2-8e06-fab2d12a66d7 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:29:59.327000 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9c7a8088-7c9a-4bd2-8e06-fab2d12a66d7 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:29:59.327731 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9c7a8088-7c9a-4bd2-8e06-fab2d12a66d7 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:29:59.328180 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9c7a8088-7c9a-4bd2-8e06-fab2d12a66d7 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:29:59.328616 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-9c7a8088-7c9a-4bd2-8e06-fab2d12a66d7 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:29:59.342563 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.wsgi [None req-9c7a8088-7c9a-4bd2-8e06-fab2d12a66d7 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] HTTP exception thrown: Instance 03c69bbd-ab41-4734-bf59-1160664f6188 could not be found. Aug 31 13:29:59.344217 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-9c7a8088-7c9a-4bd2-8e06-fab2d12a66d7 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Request method failure captured: Aug 31 13:29:59.344217 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: request: GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188 HTTP/1.1 Aug 31 13:29:59.344217 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept: application/json Aug 31 13:29:59.344217 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept-Encoding: identity Aug 31 13:29:59.344217 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Connection: close Aug 31 13:29:59.344217 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Length: 0 Aug 31 13:29:59.344217 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Type: application/json Aug 31 13:29:59.344217 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Host: 10.222.0.58 Aug 31 13:29:59.344217 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Openstack-System-Scope: None Aug 31 13:29:59.344217 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: User-Agent: python-urllib3/1.26.12 Aug 31 13:29:59.344217 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Auth-Token: gAAAAABjD2BMY2mL45QxnSD5LwCJvxzdtYzv5IXt87L0KdlrP9plSRC5YyREmTzryZzEfk_gpa-ONx3o2mJIAiABxvQ8xNIew9m3lkBpGkjoFfdSDHzdkvWNeIXDHh2tTnLRl0jXuSMjC-uSkFrdwwaSQX69I38bhGAd-Q0Rr_sLrzIlaBNzBOM Aug 31 13:29:59.344217 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Id: None Aug 31 13:29:59.344217 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Name: None Aug 31 13:29:59.344217 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Identity-Status: Confirmed Aug 31 13:29:59.344217 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Is-Admin-Project: True Aug 31 13:29:59.344217 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Id: default Aug 31 13:29:59.344217 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Name: Default Aug 31 13:29:59.344217 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Id: b83394c784464c69843feac5ed7050dd Aug 31 13:29:59.344217 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Name: tempest-TestVolumeBootPattern-1699852126 Aug 31 13:29:59.344217 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Role: member,reader Aug 31 13:29:59.344217 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Roles: member,reader Aug 31 13:29:59.345878 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b83394c784464c69843feac5ed7050dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b83394c784464c69843feac5ed7050dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b83394c784464c69843feac5ed7050dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b83394c784464c69843feac5ed7050dd"}]}] Aug 31 13:29:59.345878 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant: tempest-TestVolumeBootPattern-1699852126 Aug 31 13:29:59.345878 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Id: b83394c784464c69843feac5ed7050dd Aug 31 13:29:59.345878 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Name: tempest-TestVolumeBootPattern-1699852126 Aug 31 13:29:59.345878 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User: tempest-TestVolumeBootPattern-1699852126-project Aug 31 13:29:59.345878 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Id: default Aug 31 13:29:59.345878 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Name: Default Aug 31 13:29:59.345878 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Id: e6897b60675a4c99a47ed51cdcbd1d39 Aug 31 13:29:59.345878 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Name: tempest-TestVolumeBootPattern-1699852126-project Aug 31 13:29:59.345878 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: method: > Aug 31 13:29:59.345878 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: exception: Instance 03c69bbd-ab41-4734-bf59-1160664f6188 could not be found. Aug 31 13:29:59.345878 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: action_args: {'id': '03c69bbd-ab41-4734-bf59-1160664f6188'} Aug 31 13:29:59.346931 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:29:59.346931 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:29:59.346931 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 13:29:59.346931 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 13:29:59.346931 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 13:29:59.346931 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 13:29:59.346931 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 13:29:59.346931 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 13:29:59.346931 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 13:29:59.346931 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 13:29:59.346931 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03c69bbd-ab41-4734-bf59-1160664f6188 could not be found. Aug 31 13:29:59.346931 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:29:59.346931 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:29:59.346931 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:29:59.346931 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:29:59.346931 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:29:59.346931 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:29:59.346931 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:29:59.346931 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:29:59.346931 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:29:59.349389 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:29:59.349389 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 13:29:59.349389 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 13:29:59.349389 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 13:29:59.349389 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 13:29:59.349389 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 13:29:59.349389 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 13:29:59.349389 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03c69bbd-ab41-4734-bf59-1160664f6188 could not be found. Aug 31 13:29:59.349389 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:29:59.349389 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:29:59.349389 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:29:59.349389 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:29:59.349389 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:29:59.349389 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:29:59.349389 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:29:59.349389 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:29:59.349389 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03c69bbd-ab41-4734-bf59-1160664f6188 could not be found. Aug 31 13:29:59.349389 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:29:59.351553 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-9c7a8088-7c9a-4bd2-8e06-fab2d12a66d7 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Returning 404 to user: Instance 03c69bbd-ab41-4734-bf59-1160664f6188 could not be found. {{(pid=120704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:29:59.351553 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-9c7a8088-7c9a-4bd2-8e06-fab2d12a66d7 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188" status: 404 len: 111 microversion: 2.1 time: 0.036415 Aug 31 13:29:59.351553 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 605/1185] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:29:59 2022] GET /compute/v2.1/servers/03c69bbd-ab41-4734-bf59-1160664f6188 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:30:02.733378 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-940bab74-82d7-45e2-890a-2d46542fc815 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:30:02.733982 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-940bab74-82d7-45e2-890a-2d46542fc815 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: bca89234-9e28-499e-b408-3aa8576cd818] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:30:02.736619 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-bd4e9760-5072-49d9-afd5-7a6fae6f9f6a req-58edb5eb-97ec-4a21-8966-0f3d6ba74545 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bca89234-9e28-499e-b408-3aa8576cd818", "tag": "4ebcdce5-d076-425a-8235-89c452379b09"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:30:02.740613 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-940bab74-82d7-45e2-890a-2d46542fc815 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:30:02.741176 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-940bab74-82d7-45e2-890a-2d46542fc815 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:30:02.741694 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-940bab74-82d7-45e2-890a-2d46542fc815 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:30:02.742447 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-940bab74-82d7-45e2-890a-2d46542fc815 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:30:02.742955 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-940bab74-82d7-45e2-890a-2d46542fc815 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:30:02.743435 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-940bab74-82d7-45e2-890a-2d46542fc815 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:30:02.752064 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-bd4e9760-5072-49d9-afd5-7a6fae6f9f6a req-58edb5eb-97ec-4a21-8966-0f3d6ba74545 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:30:02.752768 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-bd4e9760-5072-49d9-afd5-7a6fae6f9f6a req-58edb5eb-97ec-4a21-8966-0f3d6ba74545 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:30:02.753348 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-bd4e9760-5072-49d9-afd5-7a6fae6f9f6a req-58edb5eb-97ec-4a21-8966-0f3d6ba74545 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:30:02.765458 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-bd4e9760-5072-49d9-afd5-7a6fae6f9f6a req-58edb5eb-97ec-4a21-8966-0f3d6ba74545 service nova] Creating event network-changed:4ebcdce5-d076-425a-8235-89c452379b09 for instance bca89234-9e28-499e-b408-3aa8576cd818 on hv-cinder-85442 Aug 31 13:30:02.769318 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-940bab74-82d7-45e2-890a-2d46542fc815 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: bca89234-9e28-499e-b408-3aa8576cd818] Going to try to terminate instance {{(pid=120705) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 13:30:02.771152 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-bd4e9760-5072-49d9-afd5-7a6fae6f9f6a req-58edb5eb-97ec-4a21-8966-0f3d6ba74545 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039209 Aug 31 13:30:02.772194 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 606/1186] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:30:02.864540 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-940bab74-82d7-45e2-890a-2d46542fc815 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "DELETE /compute/v2.1/servers/bca89234-9e28-499e-b408-3aa8576cd818" status: 204 len: 0 microversion: 2.1 time: 0.134884 Aug 31 13:30:02.865446 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 581/1187] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 31 13:30:02 2022] DELETE /compute/v2.1/servers/bca89234-9e28-499e-b408-3aa8576cd818 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:30:02.875274 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-969d423e-a80d-4785-adec-a48681970051 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:30:02.876347 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-969d423e-a80d-4785-adec-a48681970051 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: bca89234-9e28-499e-b408-3aa8576cd818] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:30:02.883507 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-969d423e-a80d-4785-adec-a48681970051 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:30:02.884063 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-969d423e-a80d-4785-adec-a48681970051 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:30:02.884499 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-969d423e-a80d-4785-adec-a48681970051 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:30:02.885210 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-969d423e-a80d-4785-adec-a48681970051 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:30:02.885655 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-969d423e-a80d-4785-adec-a48681970051 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:30:02.886118 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-969d423e-a80d-4785-adec-a48681970051 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:30:03.020517 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.policy [None req-969d423e-a80d-4785-adec-a48681970051 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120704) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:30:03.029030 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-969d423e-a80d-4785-adec-a48681970051 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/bca89234-9e28-499e-b408-3aa8576cd818" status: 200 len: 1577 microversion: 2.1 time: 0.158804 Aug 31 13:30:03.029621 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 607/1188] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:30:02 2022] GET /compute/v2.1/servers/bca89234-9e28-499e-b408-3aa8576cd818 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:30:04.050491 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-93bf69c2-5be6-419a-a094-e32fde579963 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:30:04.051805 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-93bf69c2-5be6-419a-a094-e32fde579963 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: bca89234-9e28-499e-b408-3aa8576cd818] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:30:04.057921 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-93bf69c2-5be6-419a-a094-e32fde579963 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:30:04.058401 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-93bf69c2-5be6-419a-a094-e32fde579963 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:30:04.058836 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-93bf69c2-5be6-419a-a094-e32fde579963 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:30:04.059531 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-93bf69c2-5be6-419a-a094-e32fde579963 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:30:04.060018 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-93bf69c2-5be6-419a-a094-e32fde579963 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:30:04.060439 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-93bf69c2-5be6-419a-a094-e32fde579963 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:30:04.246041 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-93bf69c2-5be6-419a-a094-e32fde579963 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:30:04.254071 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-93bf69c2-5be6-419a-a094-e32fde579963 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/bca89234-9e28-499e-b408-3aa8576cd818" status: 200 len: 1459 microversion: 2.1 time: 0.207886 Aug 31 13:30:04.254656 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 582/1189] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:30:04 2022] GET /compute/v2.1/servers/bca89234-9e28-499e-b408-3aa8576cd818 => generated 1459 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:30:04.548522 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [req-81d318b1-69dc-4abc-8bcd-626c0f61d118 req-cdb3831f-8368-4dc9-839d-0aa54231b0c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bca89234-9e28-499e-b408-3aa8576cd818", "name": "network-vif-deleted", "tag": "4ebcdce5-d076-425a-8235-89c452379b09"}]} {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:30:04.558357 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-81d318b1-69dc-4abc-8bcd-626c0f61d118 req-cdb3831f-8368-4dc9-839d-0aa54231b0c0 service nova] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:30:04.558825 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-81d318b1-69dc-4abc-8bcd-626c0f61d118 req-cdb3831f-8368-4dc9-839d-0aa54231b0c0 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:30:04.559269 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [req-81d318b1-69dc-4abc-8bcd-626c0f61d118 req-cdb3831f-8368-4dc9-839d-0aa54231b0c0 service nova] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:30:04.570371 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.compute.server_external_events [req-81d318b1-69dc-4abc-8bcd-626c0f61d118 req-cdb3831f-8368-4dc9-839d-0aa54231b0c0 service nova] Creating event network-vif-deleted:4ebcdce5-d076-425a-8235-89c452379b09 for instance bca89234-9e28-499e-b408-3aa8576cd818 on hv-cinder-85442 Aug 31 13:30:04.577021 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [req-81d318b1-69dc-4abc-8bcd-626c0f61d118 req-cdb3831f-8368-4dc9-839d-0aa54231b0c0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085235 Aug 31 13:30:04.577578 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 608/1190] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 31 13:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:30:05.280876 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-d4520ac7-1b55-4054-a948-522d0f664984 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:30:05.282015 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-d4520ac7-1b55-4054-a948-522d0f664984 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: bca89234-9e28-499e-b408-3aa8576cd818] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:30:05.292845 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d4520ac7-1b55-4054-a948-522d0f664984 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:30:05.293337 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d4520ac7-1b55-4054-a948-522d0f664984 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:30:05.293772 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d4520ac7-1b55-4054-a948-522d0f664984 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:30:05.294455 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d4520ac7-1b55-4054-a948-522d0f664984 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:30:05.294905 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d4520ac7-1b55-4054-a948-522d0f664984 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:30:05.295328 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d4520ac7-1b55-4054-a948-522d0f664984 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:30:05.327520 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d4520ac7-1b55-4054-a948-522d0f664984 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:30:05.328084 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d4520ac7-1b55-4054-a948-522d0f664984 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:30:05.328786 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-d4520ac7-1b55-4054-a948-522d0f664984 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:30:05.328920 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.objects.instance [None req-d4520ac7-1b55-4054-a948-522d0f664984 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lazy-loading 'fault' on Instance uuid bca89234-9e28-499e-b408-3aa8576cd818 {{(pid=120705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 13:30:05.376705 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.policy [None req-d4520ac7-1b55-4054-a948-522d0f664984 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6897b60675a4c99a47ed51cdcbd1d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83394c784464c69843feac5ed7050dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:30:05.386890 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-d4520ac7-1b55-4054-a948-522d0f664984 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/bca89234-9e28-499e-b408-3aa8576cd818" status: 200 len: 1229 microversion: 2.1 time: 0.113519 Aug 31 13:30:05.387521 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 583/1191] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:30:05 2022] GET /compute/v2.1/servers/bca89234-9e28-499e-b408-3aa8576cd818 => generated 1229 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:30:06.414423 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-3f329ed8-eec1-4c79-b999-d56c639a441d tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:30:06.415580 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-3f329ed8-eec1-4c79-b999-d56c639a441d tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: bca89234-9e28-499e-b408-3aa8576cd818] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:30:06.426156 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3f329ed8-eec1-4c79-b999-d56c639a441d tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:30:06.426939 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3f329ed8-eec1-4c79-b999-d56c639a441d tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:30:06.427662 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3f329ed8-eec1-4c79-b999-d56c639a441d tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:30:06.428858 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3f329ed8-eec1-4c79-b999-d56c639a441d tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:30:06.429646 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3f329ed8-eec1-4c79-b999-d56c639a441d tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:30:06.430307 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-3f329ed8-eec1-4c79-b999-d56c639a441d tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:30:06.448738 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.wsgi [None req-3f329ed8-eec1-4c79-b999-d56c639a441d tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] HTTP exception thrown: Instance bca89234-9e28-499e-b408-3aa8576cd818 could not be found. Aug 31 13:30:06.450383 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-3f329ed8-eec1-4c79-b999-d56c639a441d tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Request method failure captured: Aug 31 13:30:06.450383 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: request: GET /compute/v2.1/servers/bca89234-9e28-499e-b408-3aa8576cd818 HTTP/1.1 Aug 31 13:30:06.450383 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept: application/json Aug 31 13:30:06.450383 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept-Encoding: identity Aug 31 13:30:06.450383 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Connection: close Aug 31 13:30:06.450383 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Length: 0 Aug 31 13:30:06.450383 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Type: application/json Aug 31 13:30:06.450383 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Host: 10.222.0.58 Aug 31 13:30:06.450383 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Openstack-System-Scope: None Aug 31 13:30:06.450383 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: User-Agent: python-urllib3/1.26.12 Aug 31 13:30:06.450383 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Auth-Token: gAAAAABjD2BMY2mL45QxnSD5LwCJvxzdtYzv5IXt87L0KdlrP9plSRC5YyREmTzryZzEfk_gpa-ONx3o2mJIAiABxvQ8xNIew9m3lkBpGkjoFfdSDHzdkvWNeIXDHh2tTnLRl0jXuSMjC-uSkFrdwwaSQX69I38bhGAd-Q0Rr_sLrzIlaBNzBOM Aug 31 13:30:06.450383 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Id: None Aug 31 13:30:06.450383 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Name: None Aug 31 13:30:06.450383 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Identity-Status: Confirmed Aug 31 13:30:06.450383 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Is-Admin-Project: True Aug 31 13:30:06.450383 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Id: default Aug 31 13:30:06.450383 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Name: Default Aug 31 13:30:06.450383 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Id: b83394c784464c69843feac5ed7050dd Aug 31 13:30:06.450383 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Name: tempest-TestVolumeBootPattern-1699852126 Aug 31 13:30:06.450383 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Role: member,reader Aug 31 13:30:06.450383 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Roles: member,reader Aug 31 13:30:06.452038 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b83394c784464c69843feac5ed7050dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b83394c784464c69843feac5ed7050dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b83394c784464c69843feac5ed7050dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b83394c784464c69843feac5ed7050dd"}]}] Aug 31 13:30:06.452038 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant: tempest-TestVolumeBootPattern-1699852126 Aug 31 13:30:06.452038 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Id: b83394c784464c69843feac5ed7050dd Aug 31 13:30:06.452038 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Name: tempest-TestVolumeBootPattern-1699852126 Aug 31 13:30:06.452038 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User: tempest-TestVolumeBootPattern-1699852126-project Aug 31 13:30:06.452038 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Id: default Aug 31 13:30:06.452038 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Name: Default Aug 31 13:30:06.452038 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Id: e6897b60675a4c99a47ed51cdcbd1d39 Aug 31 13:30:06.452038 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Name: tempest-TestVolumeBootPattern-1699852126-project Aug 31 13:30:06.452038 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: method: > Aug 31 13:30:06.452038 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: exception: Instance bca89234-9e28-499e-b408-3aa8576cd818 could not be found. Aug 31 13:30:06.452038 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: action_args: {'id': 'bca89234-9e28-499e-b408-3aa8576cd818'} Aug 31 13:30:06.452936 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:30:06.452936 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:30:06.452936 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 13:30:06.452936 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 13:30:06.452936 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 13:30:06.452936 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 13:30:06.452936 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 13:30:06.452936 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 13:30:06.452936 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 13:30:06.452936 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 13:30:06.452936 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bca89234-9e28-499e-b408-3aa8576cd818 could not be found. Aug 31 13:30:06.452936 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:30:06.452936 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:30:06.452936 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:30:06.452936 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:30:06.452936 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:30:06.452936 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:30:06.452936 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:30:06.452936 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:30:06.452936 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:30:06.454807 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:30:06.454807 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 13:30:06.454807 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 13:30:06.454807 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 13:30:06.454807 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 13:30:06.454807 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 13:30:06.454807 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 13:30:06.454807 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bca89234-9e28-499e-b408-3aa8576cd818 could not be found. Aug 31 13:30:06.454807 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:30:06.454807 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:30:06.454807 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:30:06.454807 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:30:06.454807 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:30:06.454807 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:30:06.454807 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:30:06.454807 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:30:06.454807 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bca89234-9e28-499e-b408-3aa8576cd818 could not be found. Aug 31 13:30:06.454807 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:30:06.456313 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-3f329ed8-eec1-4c79-b999-d56c639a441d tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Returning 404 to user: Instance bca89234-9e28-499e-b408-3aa8576cd818 could not be found. {{(pid=120704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:30:06.456313 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-3f329ed8-eec1-4c79-b999-d56c639a441d tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/bca89234-9e28-499e-b408-3aa8576cd818" status: 404 len: 111 microversion: 2.1 time: 0.045391 Aug 31 13:30:06.456313 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 609/1192] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:30:06 2022] GET /compute/v2.1/servers/bca89234-9e28-499e-b408-3aa8576cd818 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:30:06.910443 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-06fba32e-b08a-4ff8-b242-0c9b146097f7 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:30:06.911011 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.compute.api [None req-06fba32e-b08a-4ff8-b242-0c9b146097f7 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: c8a2a22b-1752-4a98-95cf-3acd9440b8c5] Fetching instance by UUID {{(pid=120705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:30:06.917697 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-06fba32e-b08a-4ff8-b242-0c9b146097f7 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:30:06.918238 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-06fba32e-b08a-4ff8-b242-0c9b146097f7 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:30:06.918620 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-06fba32e-b08a-4ff8-b242-0c9b146097f7 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:30:06.919312 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-06fba32e-b08a-4ff8-b242-0c9b146097f7 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:30:06.919764 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-06fba32e-b08a-4ff8-b242-0c9b146097f7 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:30:06.920329 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG oslo_concurrency.lockutils [None req-06fba32e-b08a-4ff8-b242-0c9b146097f7 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:30:06.934044 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.wsgi [None req-06fba32e-b08a-4ff8-b242-0c9b146097f7 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] HTTP exception thrown: Instance c8a2a22b-1752-4a98-95cf-3acd9440b8c5 could not be found. Aug 31 13:30:06.935725 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-06fba32e-b08a-4ff8-b242-0c9b146097f7 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Request method failure captured: Aug 31 13:30:06.935725 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: request: DELETE /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5 HTTP/1.1 Aug 31 13:30:06.935725 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Accept: application/json Aug 31 13:30:06.935725 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Accept-Encoding: identity Aug 31 13:30:06.935725 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Connection: close Aug 31 13:30:06.935725 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Content-Length: 0 Aug 31 13:30:06.935725 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Content-Type: application/json Aug 31 13:30:06.935725 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Host: 10.222.0.58 Aug 31 13:30:06.935725 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: Openstack-System-Scope: None Aug 31 13:30:06.935725 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: User-Agent: python-urllib3/1.26.12 Aug 31 13:30:06.935725 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Auth-Token: gAAAAABjD2BMY2mL45QxnSD5LwCJvxzdtYzv5IXt87L0KdlrP9plSRC5YyREmTzryZzEfk_gpa-ONx3o2mJIAiABxvQ8xNIew9m3lkBpGkjoFfdSDHzdkvWNeIXDHh2tTnLRl0jXuSMjC-uSkFrdwwaSQX69I38bhGAd-Q0Rr_sLrzIlaBNzBOM Aug 31 13:30:06.935725 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Domain-Id: None Aug 31 13:30:06.935725 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Domain-Name: None Aug 31 13:30:06.935725 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Identity-Status: Confirmed Aug 31 13:30:06.935725 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Is-Admin-Project: True Aug 31 13:30:06.935725 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Domain-Id: default Aug 31 13:30:06.935725 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Domain-Name: Default Aug 31 13:30:06.935725 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Id: b83394c784464c69843feac5ed7050dd Aug 31 13:30:06.935725 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Project-Name: tempest-TestVolumeBootPattern-1699852126 Aug 31 13:30:06.935725 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Role: member,reader Aug 31 13:30:06.935725 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Roles: member,reader Aug 31 13:30:06.937347 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b83394c784464c69843feac5ed7050dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b83394c784464c69843feac5ed7050dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b83394c784464c69843feac5ed7050dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b83394c784464c69843feac5ed7050dd"}]}] Aug 31 13:30:06.937347 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant: tempest-TestVolumeBootPattern-1699852126 Aug 31 13:30:06.937347 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant-Id: b83394c784464c69843feac5ed7050dd Aug 31 13:30:06.937347 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-Tenant-Name: tempest-TestVolumeBootPattern-1699852126 Aug 31 13:30:06.937347 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User: tempest-TestVolumeBootPattern-1699852126-project Aug 31 13:30:06.937347 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Domain-Id: default Aug 31 13:30:06.937347 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Domain-Name: Default Aug 31 13:30:06.937347 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Id: e6897b60675a4c99a47ed51cdcbd1d39 Aug 31 13:30:06.937347 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: X-User-Name: tempest-TestVolumeBootPattern-1699852126-project Aug 31 13:30:06.937347 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: method: > Aug 31 13:30:06.937347 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: exception: Instance c8a2a22b-1752-4a98-95cf-3acd9440b8c5 could not be found. Aug 31 13:30:06.937347 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: action_args: {'id': 'c8a2a22b-1752-4a98-95cf-3acd9440b8c5'} Aug 31 13:30:06.938236 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:30:06.938236 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:30:06.938236 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 13:30:06.938236 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 13:30:06.938236 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 13:30:06.938236 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 13:30:06.938236 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 13:30:06.938236 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 13:30:06.938236 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 13:30:06.938236 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 13:30:06.938236 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8a2a22b-1752-4a98-95cf-3acd9440b8c5 could not be found. Aug 31 13:30:06.938236 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:30:06.938236 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:30:06.938236 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:30:06.938236 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:30:06.938236 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:30:06.938236 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:30:06.938236 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:30:06.938236 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:30:06.938236 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:30:06.939632 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:30:06.939632 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 13:30:06.939632 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 13:30:06.939632 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 13:30:06.939632 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 13:30:06.939632 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 13:30:06.939632 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 13:30:06.939632 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 13:30:06.939632 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 13:30:06.939632 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8a2a22b-1752-4a98-95cf-3acd9440b8c5 could not be found. Aug 31 13:30:06.939632 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:30:06.939632 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:30:06.939632 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:30:06.939632 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:30:06.939632 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:30:06.939632 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:30:06.939632 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:30:06.939632 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:30:06.939632 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8a2a22b-1752-4a98-95cf-3acd9440b8c5 could not be found. Aug 31 13:30:06.939632 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: ERROR nova.api.openstack.wsgi Aug 31 13:30:06.941133 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-06fba32e-b08a-4ff8-b242-0c9b146097f7 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Returning 404 to user: Instance c8a2a22b-1752-4a98-95cf-3acd9440b8c5 could not be found. {{(pid=120705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:30:06.941133 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-06fba32e-b08a-4ff8-b242-0c9b146097f7 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5" status: 404 len: 111 microversion: 2.1 time: 0.030761 Aug 31 13:30:06.941133 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 584/1193] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 31 13:30:06 2022] DELETE /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:30:06.945931 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-56976ccf-659d-46b9-86d2-34493575e0a2 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '>' {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:30:06.946544 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.compute.api [None req-56976ccf-659d-46b9-86d2-34493575e0a2 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] [instance: c8a2a22b-1752-4a98-95cf-3acd9440b8c5] Fetching instance by UUID {{(pid=120704) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:30:06.952820 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-56976ccf-659d-46b9-86d2-34493575e0a2 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:30:06.953287 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-56976ccf-659d-46b9-86d2-34493575e0a2 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:30:06.953718 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-56976ccf-659d-46b9-86d2-34493575e0a2 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:30:06.954393 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-56976ccf-659d-46b9-86d2-34493575e0a2 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Acquiring lock "a934bcd7-fa17-435e-9285-cae87d73e85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:30:06.954833 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-56976ccf-659d-46b9-86d2-34493575e0a2 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:30:06.955246 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG oslo_concurrency.lockutils [None req-56976ccf-659d-46b9-86d2-34493575e0a2 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Lock "a934bcd7-fa17-435e-9285-cae87d73e85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:30:06.968640 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.wsgi [None req-56976ccf-659d-46b9-86d2-34493575e0a2 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] HTTP exception thrown: Instance c8a2a22b-1752-4a98-95cf-3acd9440b8c5 could not be found. Aug 31 13:30:06.970135 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-56976ccf-659d-46b9-86d2-34493575e0a2 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Request method failure captured: Aug 31 13:30:06.970135 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: request: GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5 HTTP/1.1 Aug 31 13:30:06.970135 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept: application/json Aug 31 13:30:06.970135 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Accept-Encoding: identity Aug 31 13:30:06.970135 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Connection: close Aug 31 13:30:06.970135 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Length: 0 Aug 31 13:30:06.970135 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Content-Type: application/json Aug 31 13:30:06.970135 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Host: 10.222.0.58 Aug 31 13:30:06.970135 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: Openstack-System-Scope: None Aug 31 13:30:06.970135 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: User-Agent: python-urllib3/1.26.12 Aug 31 13:30:06.970135 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Auth-Token: gAAAAABjD2BMY2mL45QxnSD5LwCJvxzdtYzv5IXt87L0KdlrP9plSRC5YyREmTzryZzEfk_gpa-ONx3o2mJIAiABxvQ8xNIew9m3lkBpGkjoFfdSDHzdkvWNeIXDHh2tTnLRl0jXuSMjC-uSkFrdwwaSQX69I38bhGAd-Q0Rr_sLrzIlaBNzBOM Aug 31 13:30:06.970135 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Id: None Aug 31 13:30:06.970135 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Domain-Name: None Aug 31 13:30:06.970135 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Identity-Status: Confirmed Aug 31 13:30:06.970135 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Is-Admin-Project: True Aug 31 13:30:06.970135 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Id: default Aug 31 13:30:06.970135 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Domain-Name: Default Aug 31 13:30:06.970135 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Id: b83394c784464c69843feac5ed7050dd Aug 31 13:30:06.970135 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Project-Name: tempest-TestVolumeBootPattern-1699852126 Aug 31 13:30:06.970135 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Role: member,reader Aug 31 13:30:06.970135 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Roles: member,reader Aug 31 13:30:06.971924 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b83394c784464c69843feac5ed7050dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b83394c784464c69843feac5ed7050dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b83394c784464c69843feac5ed7050dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b83394c784464c69843feac5ed7050dd"}]}] Aug 31 13:30:06.971924 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant: tempest-TestVolumeBootPattern-1699852126 Aug 31 13:30:06.971924 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Id: b83394c784464c69843feac5ed7050dd Aug 31 13:30:06.971924 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-Tenant-Name: tempest-TestVolumeBootPattern-1699852126 Aug 31 13:30:06.971924 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User: tempest-TestVolumeBootPattern-1699852126-project Aug 31 13:30:06.971924 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Id: default Aug 31 13:30:06.971924 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Domain-Name: Default Aug 31 13:30:06.971924 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Id: e6897b60675a4c99a47ed51cdcbd1d39 Aug 31 13:30:06.971924 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: X-User-Name: tempest-TestVolumeBootPattern-1699852126-project Aug 31 13:30:06.971924 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: method: > Aug 31 13:30:06.971924 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: exception: Instance c8a2a22b-1752-4a98-95cf-3acd9440b8c5 could not be found. Aug 31 13:30:06.971924 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: action_args: {'id': 'c8a2a22b-1752-4a98-95cf-3acd9440b8c5'} Aug 31 13:30:06.972929 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: {{(pid=120704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:30:06.972929 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:30:06.972929 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 13:30:06.972929 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 13:30:06.972929 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 13:30:06.972929 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 13:30:06.972929 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 13:30:06.972929 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 13:30:06.972929 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 13:30:06.972929 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 13:30:06.972929 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8a2a22b-1752-4a98-95cf-3acd9440b8c5 could not be found. Aug 31 13:30:06.972929 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:30:06.972929 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:30:06.972929 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:30:06.972929 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:30:06.972929 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:30:06.972929 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:30:06.972929 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:30:06.972929 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:30:06.972929 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:30:06.974537 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:30:06.974537 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 13:30:06.974537 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 13:30:06.974537 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 13:30:06.974537 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 13:30:06.974537 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 13:30:06.974537 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 13:30:06.974537 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8a2a22b-1752-4a98-95cf-3acd9440b8c5 could not be found. Aug 31 13:30:06.974537 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:30:06.974537 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:30:06.974537 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:30:06.974537 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:30:06.974537 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:30:06.974537 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:30:06.974537 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:30:06.974537 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:30:06.974537 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8a2a22b-1752-4a98-95cf-3acd9440b8c5 could not be found. Aug 31 13:30:06.974537 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: ERROR nova.api.openstack.wsgi Aug 31 13:30:06.976333 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: DEBUG nova.api.openstack.wsgi [None req-56976ccf-659d-46b9-86d2-34493575e0a2 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Returning 404 to user: Instance c8a2a22b-1752-4a98-95cf-3acd9440b8c5 could not be found. {{(pid=120704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:30:06.976333 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: INFO nova.api.openstack.requestlog [None req-56976ccf-659d-46b9-86d2-34493575e0a2 tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5" status: 404 len: 111 microversion: 2.1 time: 0.029438 Aug 31 13:30:06.976333 dv-cinder-854428-2-iscsi devstack@n-api.service[120704]: [pid: 120704|app: 0|req: 610/1194] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 31 13:30:06 2022] GET /compute/v2.1/servers/c8a2a22b-1752-4a98-95cf-3acd9440b8c5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:30:08.293910 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: DEBUG nova.api.openstack.wsgi [None req-e6ad80ae-3afd-458c-bdf2-f805bd354e4f tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] Calling method '.version_select at 0x7f19514eba60>' {{(pid=120705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:30:08.319266 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: INFO nova.api.openstack.requestlog [None req-e6ad80ae-3afd-458c-bdf2-f805bd354e4f tempest-TestVolumeBootPattern-1699852126 tempest-TestVolumeBootPattern-1699852126-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-79203537" status: 202 len: 0 microversion: 2.1 time: 0.029200 Aug 31 13:30:08.319774 dv-cinder-854428-2-iscsi devstack@n-api.service[120705]: [pid: 120705|app: 0|req: 585/1195] 10.222.0.58 () {58 vars in 1257 bytes} [Wed Aug 31 13:30:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-79203537 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)